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Address  of  Welcome 


William  Lowe  Bryan 

It  is  greatly  to  he  desired  that  the  efforts  to  discover  a  persistence  test 
should  he  successful.  An  adequate  persistence  tesl  would  be  of  more  value 
than  an  intelligence  test.  Individuals  are  lifted  out  of  their  intelligence 
.•lass  up  or  dow  n  by  I  heir  greater  or  less  persistence.  Until  such  test  can  be 
made  the  fact  must  he  taken  account  of  as  well  as  possible  by  informal  means. 

In  every  science  laboratory  experimentation  should  so  far  as  possible  be 
supplemented  by  held  observation.  In  the  laboratory  we  eliminate  dis- 
turbing conditions  in  order  to  secure  precision,  but  in  practice  these  dis- 
turbing conditions  an1  again  present  and  may  be  so  important  as  to  quite 
upset  the  results  of  the  laboratory  studies.  In  the  best  modern  biological 
studies  the  two  methods  are  united.  They  should  by  all  means  be  united 
in  the  study  of  child  life. 


(3) 


Contributions  of  Measurements  to  Methods 

of  Teaching 


S.    A.   Coi  in 

I  \vw  i  to  speak  tonight  on  the  topic  I  am  most  interested  in  methods 
of  teaching.  The  title,  "Contributions  of  Measurements  to  Methods  of 
Teaching",  gives  me  the  chance  to  discuss  an  idea  aboul  measuremenl  work 
thai  some  of  us  have  had  from  the  beginning,  alt  ho  this  point  of  view  has 
not  always  been  understood  by  some  of  the  teachers  who  have  used  our  tests. 

As  I  see  it,  tests  arc  a  means  of  controlling  methods  of  teaching.  They 
are  cf  no  value  except  to  the  teacher  who  uses  the  results  intelligently. 
I  want  to  try  to  show  you  tonight  in  various  ways  how  the  use  of  tests  has 
contributed  to  the  building  up  of  a  knowledge  of  the  proper  ways  of  teaching, 
and  how.  as  we  work  with  tests  in  the  different  fields,  we  are  constructing  a 
perfectly  definite  philosophy  of  teaching  which  is  enabling  us  to  do  better 
and  better  work. 

I  am  going  to  begin  with  a  definition  of  education  in  order  that  we  may 
start  with  the  same  basic  ideas.  This  is  the  definition  of  education  which 
I  like  best:  Education  is  a  process  of  helping  children  to  change  themselves 
from  where  they  are  toward  where  Ave  think  they  ought  to  be.  T  like  that 
definition  for  many  reasons.  First,  1  like  to  emphasize  the  fact  thai  teaching 
is  a  process  in  which  a  number  of  different  people  have  to  cooperate.  Edu- 
cation is  not  a  matter  of  taking  a  course  here  and  there.  It  is  something 
more  than  that.  What  you  can  accomplish  is  determined  in  large  measure 
by  what  war  done  by  those  who  came  before  you,  while  what  you  do  will 
determine  in  part  the  success  or  failure  of  those  who  come  after  you.  Co- 
operation is  essential  to  success. 

Then  education  ought  to  be  a  process  of  helping  children.  That  puts 
the  emphasis  where  it  belongs.  Children  must  change  themselves;  the 
teacher  cannot  do  it  for  them.  It  is  the  teacher's  place  to  help  the  children 
change  themselves.  Now  the  children  are  going  to  change  themselves  from 
where  they  are.  The  only  kind  of  teaching  that  counts  is  that  in  which  we 
begin  to  work  with  the  child  where  he  is.  We  are  going  to  change  trim  from 
w  here  he  LS  toward  the  place  where  we  think  he  ought  to  be.  The  tests  help 
us  to  measure  where  the  children  are;  and  when  we  know  w  here  I  lie  children 
are  and  where  they  ought  to  be,  the  ie>ts  can  help  us  to  decide  whether  a 
new  method  is  an  improvement  over  t  he  one  we  have  had. 

The  definition  is  of  value  because  it  enables  us  to  show  clearly  (he  func- 
tions of  measurements.  They  are:  (1)  the  definition  of  goals;  (2)  the  de- 
scription of  children;  3  the  determination  of  the  efficiency  of  different 
met  hods.  With  i  he  aid  of  measuri  i n eii ts  we  have  been  defining  the  goal  of 
education.     For   instance,    in    the  case   of   handwriting,    measuremenl    has 

helped  us  to  define  the  goal.      Tin    standard   was  sel    up  !•;     A    res,  after  the 
Thorndike  scale  had  given  us  some  idea  how   to  iX<>  to  work  tc  measure  hand- 
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writing.  Writing  ability  is  measured  in  two  dimensions,  rate  and  quality. 
When  we  find  a  second  grade  child  who  writes  at  the  rate  of  32  letters  a 
minute  with  a  quality  of  38,  we  have  an  illustration  of  the  average  of  third 
grade  ability.  If  a  man  80  years  old  writes  at  this  rate  and  quality,  he  is 
third  grade  in  writing  ability.  In  other  words,  grade  becomes  a  level  of 
ability  instead  of  a  group  of  children.  When  we  measure  children  in  respect 
to  such  standards,  we  can  see  where  they  stand. 

1  do  not  think  people  half  realize  the  contribution  measurements  has 
made  to  definiteness  of  aim.  For  instance,  some  people  say  that  we  do  not 
write  as  well  in  school  today  as  children  used  to  write.  We  find  some  people, 
who  have  not  had  measurement  work,  saying  they  would  like  to  go  back  to 
the  good  old  times.  This  is  a  reasonable  conclusion  if  you  reach  it  on  the 
basis  of  their  fads.     That  is  quite  easy  to  prove. 

We  found  in  the  city  of  Detroit,  in  the  attic  of  our  board  of  education 
building,  a  book  containing  specimens  of  writing  of  500  children  prepared 
for  the  centennial  exhibition  in  1876.  There  wrrv  500  samples  from  the 
second  to  the  eighth  grade,  and  every  one  of  them  in  copper  plate  writing. 
Anyone  who  remembers  the  writing  of  those  days  would  be  inclined  to  say: 
"These  new-fangled  ways  of  teaching  are  no  good.  When  I  went  to  school 
our  teacher  would  not  let  us  turn  in  a  paper  with  writing  which  was  not 
perfectly  made.  We  had  to  produce  perfect  copies."  When  our  writing 
supervisor  found  this  book,  a  question  immediately  suggested  itself  to  all  of 
us:  "What  is  the  writing  of  those  people  like  today?"  From  1876  to  the 
present  time  makes  about  time  enough  for  those  people,  to  have  been  out  of 
school  forty-five  years.  For  instance,  there  was  a  sample  in  this  book  from 
a  boy  who  is  now  principal  of  cne  of  our  largest  high  schools,  and  another 
from  a  girl  who  is  now  supervisor  of  English.  Altogether  we  were  able  to 
locate  about  90  people  in  Detroit  whose  writing  as  children  was  in  that 
book  of  samples.  So  we  sent  to  these  people  and  asked  them  to  write  the 
same  material,  then  compared  it  with  their  writing  today.  The  90  samples 
average  about  55  Ayres,  and  many  of  the  samples  were  very  poor  indeed. 
Was  that  writing  in  1876  so  fine  then,  or  did  they  have  wrong  standards? 
They  succeeded  in  achieving  the  goals  they  aimed  at.  All  the  writing  done 
was  copper  plate  writing,  but  how  about  the  method  by  which  it  was 
achieved?  The  men  and  women  who  wrote  for  us  told  about  the  slow, 
painful  process  by  which  the  fine  specimens  of  1876  were  brought  about. 
Under  this  training  they  acquired  a  kind  of  ability  in  writing  which  was  not 
at  all  the  same  ability  to  write  that  is  desired  in  life. 

We  know  today  that  the  writing  we  teach  in  school  must  be  of  such 
character  that  it  will  stand  up  under  ordinary  usage.  We  must  consider 
rale  as  well  as  quality.  The  standard  we  set  today  for  the  eighth  grade  is 
quality  lit)  and  a  rate  of  about  85  to  90  letters  a  minute,  which  insure  the 
child  writing  habits  that  Avill  produce  legible  writing  under  conditions  of 
actual  life  use.  Many  investigations  have  shown  that  quality  (><)  is  about 
the  quality  needed  in  various  commercial  situations  where  writing  is  used. 
We  ha\  e  e\  idence  1  hat  a  quality  of  about-  60,  with  a  rate  of  85  to  (.K)  or  better, 
is  a  reasonable  goal  for  schools  today.  In  practically  every  sort  of  educa- 
tional work  there  is  going  on  a  similar  definition  cf  the  objectives  toward 
which  we  work. 

So  much  for  definition  of  goal.     What    about   measurement  of  children? 
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We  base  the  teaching  of  children  today  <>n  measurement  of  their  actual 
abilities.     This  was  uo1  true  of  the  days  thai  have  gone. 

One  of  our  high  school  teachers  of  English  collected  a  number  of  samples 
ni'  English  composition,  sonic  written  by  children,  some  by  authors  of  well 
known  reputation,  copied  in  children's  writing.  He  bad  samples  ranging 
all  the  way  from  verj  fine  compositions  to  a  ery  poor  qualities.  He  submitted 
them  in  the  teachers  in  Detroil  high  school  and  in  high  schools  in  other 
places.  He  asked  the  teachers  to  pick  oul  of  this  collection  of  composite  us 
thai  sample  which  was  the  verj  lowesl  they  would  accept  for  entrance  to 
high  school.  Thai  quality  of  composition,  then,  would  be  sel  up  as  a  mini- 
mum for  a  child  to  obtain  for  entrance  to  high  school.  In  this  way  he  goi 
from  the  English  teachers  a  statement  of  their  goals.  After  they  had 
selected  the  compositions  he  measured  them  by  the  llillegas  scale  by  which 
we  can  interpret  merit  in  composition  in  absolute  terms.  At  the  same  time 
he  measured  the  actual  composition  ability  of  the  entering  class.  The 
teacher's  value  was  aboul  75  mi  the  Hillegas  Scale  and  the  pupil's  value 
aboul  ">tt.  This  represents  four  years  of  slverage  progress.  That  is.  the 
teachers  tended  to  set  standards  three  and  four  years  aboA  e  the  actual  abilities 
of  the  children,  a  goal  probably  impossible  of  achievement.  This  same  situa- 
tion exists  in  arithmetic,  m  history,  and  all  along  the  line.  In  teaching  it  is 
impossible  to  plan  our  work  intelligently  unless  firsl  of  all  we  have  an  ob- 
jective standard,  then  use  it  to  measure  t  lie  children  and  see  where  they 
stand,  then  base  our  work  on  their  actual  needs. 

What  contribution  has  education  made  to  method?  The  contributions 
have  been  cf  many  types  and  characters.  1  am  going  to  take  one  of  the 
most  recent  studies  in  reading  from  the  University  of  Chicago  as  an  illustra- 
tion. 

A  study  was  made  of  the  voice-  and  eye-span  in  reading.  They  recorded 
and  measured  the  movements  of  the  eye  and  kept  track  also  of  where  the 
voice  was  at  the  same  time.  The  eye  and  voice  moved  independently. 
When  the  eye  was  a  certain  distance  m  advance,  the  voice  began  to  read. 
Usually  the  voice  was  several  words  behind  the  eye,  bu1  at  the  end  of  the 
sentence  there  was  a  long  pause  while  the  voice  caught  up.  As  we  study 
such  a  record  we  come  to  understand  the  play  of  the  eye  and  voice  together. 
In  other  words,  t  hese  exact  st  in  lies  of  w  hat  goes  on  in  school  work  show  that 
reading  is  a  very  complex  process,  and  thai  the  child  reads,  not  by  looking 
at  each  letter  or  word,  but  by  pausing  a1  certain  points  and  taking  in  a  whole 
ana  at  a  time.  This  proves  very  clearly  Ihat  the  old  method  of  teaching 
by  letters  w  as  w  rung. 

We  changed   from   the  letter  method   1<>  the  word  and   sentence  method 

metime  ago.     Bui    we   have  in   manj    schools  today   intensive  drills  on 

methods  of  making  sounds,  so  that   the  child  may  he  able  to  pronounce  the 

word-  he  reads.     The  people  who  advocate  these  methods  claim  that   it   is 

quite  impossible  for  a  child  to  learn  except  by  this  system.     However,  we 

older    people    wire    ]io|    taUghl    thai    System    when    We   Weill    to   school,   and    we 

certainly  cannot  use  it  now.  We  would  have  to  lie  instructed  before  we 
could  use  it.  ^  i  t  somehow  we  learned  to  read.  Some  da>  somebody  is 
go iic;  to  coiiie  along  and  do  for  t  he  oral  reading  of  children  precisely  the  same 
thin-  ihat  ha-  been  done  fpr  th  .ml  voice-span      Our  presenl  phonic 

methods  are  probably  wrong.     From  the  beginning  we  must  put  children  in 
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situations  were  they  may  establish  a-;  early  as  possible  (hose  habits  they  will 
use  thruoul  life.  The  problem  is  clearly  denned,  is  it  not?  For  the  beginning 
reading  we  must  adopt  some  scheme  which  will  enable  the  child  to  work  in 
the  right  way  from  the  very  first.  Measurement  is  helping  us  to  develop 
that  scheme. 

We  are  trying  to  set  up  in  Detroit  a  method  which  will  enable  children 
to  help  themselves.  We  are  trying  to  develop  a  series  of  self-help  methods 
in  the  teaching  of  reading.  We  believe  thai  we  must  leach  the  child  to 
help  himself.  Bere  is  a  teaching  sheet  with  two  words-,  apple  and  tree,  lie 
is  given  a  special  dictionary  with  the  words  he  must  use.  like  green  and  red, 
illustrated.  He  learns,  by  demonstration  with  the  teacher,  to  cut  out  and 
paste  and  color.  He  cuts  out  1  he  tree,  colors  it,  and  he  pastes  the  apple  on 
the  tree,  being  guided  in  his  making  of  Hie  picture  by  the  printed  words. 
He  learns  the  words  thru  this  construction  of  a  bimple  picture.  Then  as  a 
tesl  he  is  given  a  little  story  about-  the  picture  to  read.  When  he  finishes 
his  constructive  work  he  compares  it  with  the  model  on  the  teacher's  desk, 
and  sees  whether  it  is  correct.  It  it  is  correct,  he  is  allowed  to  try  to  read. 
When  the  test  proves  he  has  mastered  the  story,  he  can  take  it  home  and 
show  his  parents.  Thus  he  vets  a  chance  to  see  directly  the  reading  process 
as  a  process  by  which  he  accomplishes  certain  results  that  he  wishes  to 
achieve.  In  other  words,  he  learns  to  use  his  reading  as  a  tool  from  the 
beginning. 

Now  what  happens  when  we  try  this  with  children?  They  learn  to  read 
at  a  most  amazing'  rate.  This  method  produces  self-activity,  and  the  value 
of  the  results  in  terms  of  self-direction,  self-appraisal,  and  self-control  is 
much  greater  than  in  the  ordinary  reading  situation.  Some  teachers  say. 
"All  thai  machinery  to  learn  two  or  three  words'."'  Wait  a  minute!  What 
is  education  for?  Is  reading  the  final  outcome  of  education  for  wrhich  you 
work?  Or  is  reading  merely  a  by-product?  Reading  is  merely  a  means  to 
an  end,  a  tool.  We  ought  to  work  for  power,  not  merely  skill.  The  new 
method  yields  larger  returns  in  both  power  and  personality.  Let  me  show 
you,  if  I  can,  what  T  mean. 

Let  us  take  arithmetic.  Here  an-  some  conventional  textbook'  problems. 
We  are  going  to  call  this  one  the  star-apple  problem. 

Fig.  I.      (Omitted  by  the  author.) 

Here  is  the  same  problem  presented  in  a  different  way. 

Figure  II.     (Omitted  by  the  author,  i 

The  problem  is  not  presented  in  words,  but  in  a  situation.  The  child  is 
confronted  with  a  situation  in  which  he  is  called  upon  to  make  adjustments. 
He  must  use  his  arithmetic  as  a  means  to  an  end,  as  a  tool,  ("an  children 
do  that?  You  are  working  to  produce  changes  in  the  child  that  will  be  of 
real  value  in  lite,  are  you  not?  We  have  the  idea  in  Detroit  that  such 
things  as  reading  and  writing  are  not  the  real  essentials,  t  hat  there  are  some 
other  things  going  on  of  more  importance. 

Let  me  show  you  wha1  I  mean.  A  comparison  of  the  results  from  these 
two  tests  w  ith  a  class  in  the  University  of  Chicago  last  summer  and  an  eighth 
grade  class  in  Detroit  shows  thai  two  results  are  practically  the  same.  The 
children  would  do  the  textbook  problems  as  well  as  adults.  The  score  for 
both  was  95  per  cent  correct.  Bui  with  the  situation,  the  score  for  the 
children  was  but  42  per  cent  correct,  while  for  the,  adults  it  was  88  per  cent 
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What  is  it  that  the  business  man  wants  of  bis  employers?  U  lial  is  it  we  are 
teaching  our  children  in  school, —  to  follow  certain  instructions  thai  we  give? 
Or  do  we  want  them  intelligent,  so  they  can  take  bold  of  a  situation  and  make 
adjustments  in  order  to  achieve  a  given  cud?  Isn't  it  barely  possible  thai 
we  bave  missed  the  mosl  \ital  elements  in  education  by  choosing  the  wrong 
-Mids?  Measurement  will  help  us  to  find  out.  In  Detroil  we  believe  thai 
the  reason  why  children  can  do  problems  in  words  and  cannot  handle  actual 
situations  is  because  we  have  not  been  working  to  develop  the  righl  kind  of 
abilities.  We  have  been  training  for  arithmetic  and  not  for  the  development 
of  the  children.  They  fail  because  they  do  Q01  have  the  initiative  to  tell 
themselves  what  to  do.  They  do  not  have  the  practical  ability  to  analyze 
the  situation  and  pul  the  knowledge  which  they  have  to  practical  use. 

Let  me  tell  you  the  story  of  a  boy.  One  of  his  friend-  had  a  rifle  given  to 
him  by  his  father.  Several  cf  the  boys  in  the  neighborhood  had  rifles,  and 
this  boy  wanted  a  rifle  too.  His  father  being  wise,  said.  "Ask  your  mother." 
His  mother  said,  "No,  city  boys  should  not  have  rifles";  thai  she' did  not 
believe  in  rifles.  The  boy  wenl  hack  to  his  father  and  said.  "Didn't  you 
have  a  rifle  when  you  were  a  boy,  and  didn't  yon  enjoy  it?"  The  father 
acknowledged  that  he  did,  but  he  could  not  go  back  on  the  mother,  nor 
against  the  whole  family  who  also  objected  to  the  rifle.  So  he  said,  "If  you 
will  earn  money  enough  to  buy  a  rifle,  I  will  let  you  have  it."  The  father 
t  hought,  of  course,  t  hat  that  would  be  the  end  cf  the  rifle,  but  the  boy  made 
good. 

Now  what  happened  in  the  situation?  The  boy  did  not  like  English 
composition  in  school,  but  he  cared  enough  about  that  rifle  to  write  letters 
to  all  the  firms  that  had  rifles  to  sell.  He. can  tell  you  the  price  and  the 
bore  and  the  kind  of  ammunition  for  everj'  rifle;  in  fact,  he  can  tell  you  all 
about  rifles.  After  he  got  the  rifle,  what  do  you  suppose  he  did?  He  found 
a  young  man  who  had  just  returned  from  France,  and  he  pestered  the  life 
out  of  t  hat  soldier  to  drill  him  in  shooting.  He  act  ually  begged  to  be  taught. 
Couldn't  we  get  that  same  kind  of  situation  in  school?  Aren't  the  qualities 
that  were  developed  in  the  boy,  the  initiative,  drive,  and  executive  ability, 
those  that  we  need  in  everyday  life?  How  far  are  our  schools  at  present 
organized  so  that  we  are  working  to  develop  those  abilities  in  all  the  work 
that   w  <■  do? 

We  were  told  in  the  last  war  that  it  was  a  conflict  between  two  kinds  of 
government,  autocracy  and  democracy.  We  were  told  that  in  an  autocracy 
the  common  people  needed  only  two  qualities,  obedience  and  technical  skill. 

If    they    bave   those   qualities   and    do   ;i^    they    are    told,    the   autocrac\    gets 

along  well.  But  is  thai  the  kind  of  training  needed  in  a  democracy?  Some 
of  us  say  not;  thai  the  important  thing  in  a  democracy  is,  firsl  of  all,  for  the 
child  to  get  from  his  school  I  raining  an  ideal  of  service  as  a  Kasis  \'rr  the 
organization  of  all  his  life  purposes.  Thiscounl  ry  is  an  individualistic  country. 
We  believe  in  the  developmenl  of  the  individual,  but  if  we  develop  the 
individual  too  far,  we  lend  towards  anarchy.  On  the  other  hand,  if  we 
develop  the  individual  too  little,  we  drift  into  communism  or  some  other 
form  of  socialism.  It  is  quite  evident  that  we  need  lo  keep  in  the  middle 
Of  the  road.  We  have  to  respecl  the  nature  of  the  individual  and  fit  our 
education  around  him:  and  then  in  order  r . .  offsel  individual  tendencies  we 
have   to    make   him   so  Conscious   of   the  Contributions    the   pasl    has    made   to 
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him,  and  cf  the  contributions  which  he  can  make  to  his  fellow-men,  thai 
■•ill  his  life  long  he  will  be  doing  his  besl  tc  fulfil  his  obligation  to  the  past. 
If  I  were  a  supervisor  coming  into  your  room,  thai  is  the  first  basis  upon 
which  I  would  judge  your  work.  Arc  you  handling  each  lesson  in  such  a 
fashion  1  hat  you  bring  ou1  the  possibilities  (hat  the  lesson  has  for  making 
the  children  conscious  of  the  contributions  of  the  past  and  of  the  oppor- 
tunities for  them  to  make  contributions  in  the  future? 

The  second  thing  we  are  going  to  look  for  and  need  in  a  democracy  is 
self-direction,  —  the  ability  to  initiate  activities  and  carry  them  forward  to 
success  under  one's  own  direction.  It  is  very  easy  to  test  yourself  on  this. 
I  can  supply  you  with  a  test  right  away  so  you  can  tell  whether  cr  net  you 
are  developing  self-direction  in  your  schoolroom.  Who  sets  the  lesson?  In 
a  democracy,  each  person  forms  his  own  purposes  and  directs  his  own  affairs. 
Why  should  it  not  be  so  in  the  classroom?  Every  school  should  give  the 
children  the  opportunity  to  learn  how  to  purpose. 

As  I  see  it,  one  cf  t he  big  changes  that  is  coming  in  education  is  a.  recogni- 
tion of  the  need  for  a  shift  of  emphasis.  Formerly  people  in  this  country 
had  initiative  due  tc  their  frontier  life.  They  went  to  school  to  get  knowl- 
edge, for  once  they  had  knowledge,  they  had  also  the  power  to  apply  it. 
But  our  social  conditions  have  changed.  Life  no  longer  supplies  training 
in  the  exercise  <  f  initiative.  The  schools  must  now  develop  in  the  children 
power  to  apply  knowledge  as  well  as  give  them  essential  knowledge.  Fr  in 
the  kindergarten  on  thru  college,  the  center  of  emphasis  musl  he  teaching 
children  to  purpose.  The  curriculum  must  be  organized  1<>  give  individual 
control.  The  thing  we  must  do  is  to  teach  the  child  that  his  business  is  to 
grow  in  the  ability  to  purpose.     Purposing  means  self-direction. 

We  need  to  go  a  step  farther.  A  person  must  have  a  critical  faculty  as 
well  as  ability  to  purpose,  lie  must  learn  to  appraise  his  own  achievements. 
Who  marks  the  papers  in  the  class,  your  children  or  yourself?  Every  time 
;i  student  in  any  grade  of  work  from  the  kindergarten  to  the  college  has  to 
submit  his  results  to  somebody  else  tc  know  whether  his  work  is  satisfactory 
or  not,  we  have  autocracy  mstead  of  democracy  --  we  have  the  opposite  of 
self-appraisal.  A  greal  many  of  us  are  trying  to  develop  1  his  ability  in  the 
children  so  that  they  will  be  able  to  pass  upon  their  own  work.  First,  we 
are  going  to  gel  the  child  to  purpose  to  do  certain  things  and  then  we  are 
going  to  help  him  grow  in  his  ability  to  say  whether  or  not  he  has  achieved 
his  purposes  satisfactorily.  Jt  is  only  as  we  change  the  achievement  of  the 
individual  from  unsatisfactory  to  satisfactory  in  school  that  we  are  going  to 
get  him  tc  see  the  important  things  of  life  in  the  right  relation. 

Is  not  self-control  also  necessary  in  life?  Are  we  always  going  to  need  to  be 
under  the  control  of  policemen,  or  will  we  some  day  ourselves  obey  the  laws 
which  we  ourselves  make?  The  legislators  we  elect  are  our  legislators.  We 
send  men  to  make  the  laws  for  us;  they  are  our  laws.  But  most  cf  us  do  not 
act  on  that  basis.  Altho  Ave  teach  the  children  differently,  we  do  not  follow- 
out  that  plan  in  life.  The  opportunity  for  self-control  comes  wherever  a 
group  of  people  live  and  work  together.  Who  controls  in  the  schoolroom, 
you  or  the  students?  If  the  teacher  controls,  can  there  be  much  chance  of 
deveh  pmenl  of  self-control?  The  method  used  to  control  discipline  is  one 
of  the  best  tests  of  the  type  of  teaching  going  on  in  that  schoolroom. 

Finally,  there  is  the  vital  question  of  cooperation.     Our  civilization  has 
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grown  i"  the  place  where  the  life  of  a  upon  the  division  of 

labor.  Nine  of  us  live  the  complete  life  thai  the  frontiersman  used  to  live. 
We  do  not  raise  our  own  food,  make  our  own  clothes,  build  our  own  houses, 
etc.  Et  is  essential  that  we  learn  to  cooperate.  Do  we  realize  thai  some\*  here 
in  this  town  this  instant  there  is  a  man  caring  for  the  running  of  an  engine, 
in  order  thai  we  maj  have  these  lights?  J)o  we  realize  the  extent  to  which 
our  ac1  and  our  lives  are  dependent  en  others'.'     It  is  only  when  a  coal 

or  railroad  strike  ties  up  the  business  of  the  nation  thai  we  appreciate  what 
cooperation  means.  Some  cf  us  are  wondering  at  pres  q1  as  we  read  news 
from  England,  Italy,  and  Russia  whether  our  civilization  is  going  to  hold 
out  long  enough  to  train  a  new  generation  that  will  be  able  to  solve  the  tre- 

endous  problems  thai  face  us  at  the  presenl  time.  The  only  v. 
child  will  ever  learn  to  handle  the  machinery  of  constitutional  government 
is  in  the  schoolroom.  It  is  the  thing  which  we  must  give  him  in  school 
above  e\  erything  else,  -  the  ability  to  work  with  his  fellow -men  in  achieving 
common  social  purposes.  So  whether  you  are  teaching  history,  reading,  or 
writing,  if  J  come  into  your  classroom  the  things  by  which  1  ought  to  mark 
you  as  a  teacher  are  determined  by  the  extent  to  which  you  are  giving  those 
children  the  ideal  of  service,  -  developing  self-direction,  self-appraisal,  and 
self-control,  and  are  giving  them  the  ability  to  use  the  machinery  of  co- 
operation. 

Here  are  five  types  of  control  whieh  are  essential;  and  these  are  the  things 
we  must  measure.  Our  measurements  drive  us  into  methods  of  teaching 
which  are  quite  different  from  those  in  common  use.  It  is  easy  to  sel  up 
ideals  of  service,  self-direction,  self-appraisal,  self-control,  and  cooperation, 
but  the  real  problem,  after  all.  is  not  to  se1  up  the  ideal,  hut  to  put  it  across 
in  the  school  system.  What  is  the  biggest  problem  to  be  solved?  Is  it  not 
the  training  of  teachers  for  service?  If  you  had  4,000  teachers  on  your 
hands,  all  of  whom  have  been  trained  under  a  different  set  of  ideas,  would 
you  not  think  teacher  training  a  mighty  important  problem?  Those  of  us 
in  this  work  believe  it  is  one  of  the  most  important  problems. 

In  our  efforts  a1  teacher  training  we  have  enlisted  one  of  the  latest  tools 
that  man  has  invented  -  the  motion  picture.  The  ideal  of  service  and  co- 
operation is  not  very  much  in  evidence  in  the  picture  I  am  going  to  show  you 
tonight.  It  presents  a  lesson  in  handwriting,  so  organized  by  the  aid  of 
measurement  that  the  training  in  writing  develops  also  self-direction,  self- 
appraisal,  and  self-control.  The  film  is  called  Democracy  in  Education.1 
It  was  made  a  year  or  so  ago  at  the  tune  when  we  were  in  the  midsl  of  the 
war.  II  is  an  attempt  to  put  into  dramatic  and  striking  form  those  ideas 
which  I  have  been  trying  to  presenl  to  you  tonight.  The  first  part  of  the 
film  shows  the  philosophy  of  the  new  method,  the  second  part  shows  the 
actual  lesson  iii  writing  to  prove  it  is  possible  to  organize  school  work  very 
highlj  and  not  take  away  from  the  children  the  opportunity  of  entering  into 
it  whole-heartedly.  I  hope  von  will  see  that  the  whole  scheme  as  it  is 
worked  out  here  gives  teachers  a  chance  to  use  measurements  as  a  tool,  as  a 
mean-  of  furthering  then-  teaching,  and  not  to  be  controlled  by  it. 


'The  film  entitled  Democracj  in  Education  maj   be  obtained  for  a  limited  sho,wing 
From  the  World  Boob  Co.,  5fonkers    \    i    .  for  cost  of  transportation. 
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S.    A.    (  ioURTIS 

For  many  years  we  have  had  a  rating  scale  system  in  Detroit.  We  foci 
that  the  one  we  now  have  is  better  than  all  the  rest.  We  have  experimented 
with  different  kinds  of  rating  scales  and  we  have  found  that  before  you  can 
have  a  definite  system  it  is  necessary  to  have  some  form  of  reliable  rating. 

The  type  of  scale  which  is  in  use  in  many  places  is  the  one  on  which  are 
listed  all  the  desirable  qualities  a  teacher  should  have.  The  teacher  is 
marked  on  her  ability  to  supply  subject-matter.  We  have  worked  these 
thru  in  Detroit,  and  our  correlations  do  not  work. 

The  time  came  when  we  decided  that  the  mark  of  a  teacher  could  not  be 
decided  in  this  manner.  The  teacher's  rating  is  a  subjective  judgment  on 
the  part  of  the  principal,  an  expression  of  opinion.  The  first  kind  of  rating 
is  a  rank-order  rating;  the  second,  a  general  merit  rating;  the  third,  a  de- 
script  ion  of  that  teacher- —  a  grading  in  terms  of  certain  outstanding  qualities. 
This  is  more  of  a  measurement  scale.  There  is  no  correlation  between  the 
ability  of  the  teacher  and  her  grade  on  a  test.  We  have  some  of  our  very 
best  teachers  who  made  low  scores  in  tests  under  certain  conditions  —  some 
of  our  poorest  teachers  who  made  high  scores  under  certain  conditions.  We 
do  not  attempt  to  use  educational  measurements  as  a  means  of  rating  the 
teacher.     The  final  opinion  of  the  principal  is  better  than  anything  else. 

The  principal  has  a  rank  order  card  on  which  are  the  names  of  the  teachers 
in  the  order  of  their  merit.  For  example.  Aliss  K.  Jones  is  the  best  of  the 
teachers  in  a  certain  building,  meaning  the  best  in  the  judgment  of  the 
principal.  So  far  as  he  can  distinguish  between  Miss  Jones  and  Miss  Smith, 
Miss  Jones  is  the  better.  We  can  1  hus  show  immediately  where  the  principal 
of  that  building  rates  his  teacher. 

The  next  thing  we  do  is  to  have  the  principal  rate  a  given  quality.  All 
satisfactory  teachers  are  put  together,  and  all  unsatisfactory  teachers  marked 
"D".  Of  three  teachers,  the  extraordinary  teacher  is  marked  "A";  the  fair, 
outstanding  teacher  is  the  satisfactory  "< "  teacher.  The  "B"  teacher 
means  the  good  teacher,  between  these  two  classes. 

When  you  begin  to  grade  your  teachers  it  is  very  easy  to  grade  A  and  C 
teachers,  but  when  in  doubt  place  her  in  the  B  group.  All  the  principal  has 
to  do  is  to  hold  in  mind  these  three  grades. 

On  the  other  extreme  we  have  the  D,  D  +  ,  and  D —  groups,  in  which  go 
the  teachers  the  principal  gives  up  as  absolutely  hopeless.  D  means  that 
possibly  the  teacher  may  do  better  another  time.  D+  is  the  case  of  the 
teacher  who  is  unfit,  but  for  whom  the  principal  knows  that  nothing  much 
can  be  done.  The  teacher  who  is  old  in  service  but  who  is  being  left  behind, 
whom  it  would,  however,  be  wrong  to  dismiss,  is  in  this  group. 

When  this  system  was  put  into  work,  requests  came  in  from  the  principals 
for  another  mark.     C-  -  is  the  dumping-ground  for  many  teachers  —  the 

(  12  ) 
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teacher  who  is  about  to  be  married;  the  teacher  who  has  been  sick,  but  the 
teacher  who  will  come  back  and  be  a  good  strong  teacher.  There  are  a  num- 
ber of  those  cases  where  this  dumping-ground  is  needed. 

Going  back  to  the  rank-order  card,  we  can  nil  in  the  principal's  estimate. 
The  principal's  judgmenl  varies.  Pari  of  the  work  of  our  ciiy  is  to  bring 
the  teachers  to  righl  standards  cf  judgment.  The  minute  we  locate  three 
teachers  we  can  move  the  scale  up  and  down  the  line  if  the  principal's  judg- 
ment is  merely  on  the  wrong  level. 

The  rating  and  the  rank-order  arc  two  forms  of  rating  which  (duck  on 
each  other.  They  are  two  differenl  types  of  form.  We  find  very  often  that 
rating  in  resped  to  each  other  is  Inner  than  the  final  standard.  But  we 
need  something  more  than  this. 

Here  is  an  A  teacher;  here  is  another.  How  does  the  one  resemble  the 
first?  It'  we  need  a  principal,  which  shall  we  take'.'  The  ordinary  scale  of 
passing  on  teachers  is  a  very  difficult  one  to  handle.  It  becomes  \  ery  difficult 
to  pass  on  these  various  elements  of  a  teacher's  ability.  On  the  other  hand, 
there  are  things  we  need  to  know  to  handle  the  question. 

The  following  elements  are  considered  essential  to  teaching  ability: 
(1)  vitality.  (2)  personality,  (3)  general  intelligence,  (4)  social  intelligence; 
dealing  with  professional  work —  (5)  professional  spirit.  (6)  professional 
ability,   (7)  professional   leadership,    (8)   executive  ability,   (9)  adaptability. 

On  this  kind  of  card  we  have  the  usual  division  of  10  points.  The  rating 
of  these  teachers  is  in  a  summary  of  the  elements  named  in  the  foregoing 
slide. 

For  the  actual  rating  of  teachers  the  army  rating  scale  method  is  used. 
The  instructions  are  to  rate  these  divisions  thru  for  each  quality.  When 
you  rate  that  division  thru,  rate  the  one  thru  for  excellent  and  very  poor. 
You  will  find  that  the  pictures  of  various  individuals  will  rise  in  your  imag- 
ination. Why?  Because  they  have  been  made  up  from  the  statements  of 
different  principals  until  they  strike  upon  someone  you  know.  No  principal 
can  get  thru  that  experience  without  coming  in  contact  with  seme  who  are 
in  excellent  health,  and  some  who  are  very  low  in  vitality  .  Write  the  name 
of  that  person  in  and  use  that  for  a  guide.  For  you  and  for  me  that  name 
may  not  be  the  same.  Hut  both  represent  the  besl  type  of  that  division. 
Then,  after  writing  in  the  name  of  the  very  best,  write  in  the  name  of  the 
very  poorest-.  We  have  two  elements  of  the  scale.  Without  very  much 
trouble,  we  can  find  a  third  person  who  will  give  us  an  average.  Principals 
tend  to  come  together  on  these  averages.  This  scale  tends  to  give  tis  a  fairly 
definite  scale.  If  you  will  substitute  from  your  own  experience  the  names 
of  definite  persons,  when  you  gel  thru  you  will  have  a  complete  scale  which 
represent  -  I  hese  li\  e  dn  isions. 

The  principal  retains  these  scales.     He  keeps  them  I'r year  to  year 

and  changes  them  only  as  he  finds  persons  more  suitable. 

To  apply  tins  to  a  specific  case,  we  have  hen  a  B6  teacher  in  Room  C. 
There  are  12  in  the  building.  She  stand-  third  from  the  top,  so  she  is  third 
out  of  l'_\      The  principal  gives  her  a  general  rating  of  B. 

The  question  now   presents  itself,  Mow   do  you  summarize  these  to  gel 
the  rating?     We  don't.     There  is  ao  connection  between  the  rating  and  the 
description  on  the  card.     ( )ne  is  a  good  teacher  because  of  her  personality, 
another  good  because  of  her  adaptability.     The  value  to  be  assigned  cannot 
bo  combined  by  any  summary. 
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In  marking  pupils,  when  the  child  is  near  the  passing  mark,  we  are  likely 
to  be  liberal  with  the  child.  The  principal  does  the  same  thing  with  the 
teacher. 

The  question  now  comes  up,  What  are  the  factors  which  determine  the 
principal's  judgment'.'  The  thing  that,  stands  out  more  than  anything  else 
is  for  the  teacher  to  contribute  to  the  life  of  the  school.  The  teacher  who 
could  attend  with  ability  to  the  children  in  her  own  room  and  at  the  same 
time  contribute  to  the  other  people  in  the  building  attracts  the  principal's 
attention  more  than  any  other  type  of  teacher.  This,  1  think,  is  a  tribute 
to  the  type  of  work  winch  is  going  on  in  Detroit. 

This  chart  shows  the  correlation  between  the  judgment  of  the  principals 
concerning  teaebers  and  the  elements  prescribed  as  essential  for  a  teacher: 

Professional  leadership 87 

Professional  ability si 

Executive  ability 77 

Social  intelligence 69 

Personality 68 

Professional  spirit •'.:; 

Adaptability 63 

General  intelligence 51 

Vitality 40 

There  is  a  deadline  in  the  intelligence  scale  of  teachers  below  which  it 
is  not  safe  to  hire  individuals.  A  result  of  not  more  than  L25  on  the  Otis 
test  renders  the  applicant  doubtful;  80  means  an  almost  sure  failure. 

If  the  people  who  are  incompetent  can  be  picked  out  from  the  beginning, 
it  is  our  duty  to  the  profession  to  see  that  only  those  who  are  competent  to 
go  on  are  in  the  profession. 

The  handling  of  such  a  scale  is  difficult.  The  scale  is  not  satisfactory, 
but  we  have  the  means  of  making  it  so. 

At  the  meeting  of  the  Board  of  Education  in  Detroit  last  Thursday,  the 
superintendent  was  authorized  to  issue  two  kinds  of  contracts.  To  the 
teachers  whose  work  was  satisfactory,  a  continuing  contract  is  issued.  To 
those  whose  work  was  unsatisfactory,  a  provisional  contract  is  issued.  The 
provisional  contract  can  be  used  for  only  two  years. 

The  suggestion  has  been  made  that  there  be  some  limit  to  the  amount  of 
salary  given  for  service.  Our  minimum  for  elementary  school  teachers  now 
is  .f  1,500,  for  high  school  teachers  $1,700;  the  maximums  are  $2,000  and 
$2,600,  respectively. 

If  our  scales  are  accepted  as  a  just  rating  scale,  the  time  will  come  when 
the  next  step  will  be  payment  for  merit,  so  that  the  teacher  who  is  rated  A 
will  receive  an  additional  salary. 

Any  satisfactory  scheme,  to  be  workable,  must  lie  above  the  criticism  of 
favoritism.  I  am  quite  sure  that  within  one  or  two  years  we  shall  be  able  to 
work  out  a  system,  which,  coupled  with  the  opinion  scale,  will  rate  the 
teacher  correctly  and  disinterestedly. 


Analysis  of  School  Subjects  (Abstract) 


Charles  H.  Judd 

This  is  a  plea  for  a  type  of  study  of  educational  problems  which  is  more 
arduous  than  the  making  of  tests  or  the  comparing  of  scores.  It  is  not 
very  difficult  to  give  100  children  a  test  in  arithmetic  or  reading  and  to  show 
from  the  results  that  some  are  good  in  each  of  these  subjects,  souk  are  bad, 
and  some  mixed  in  their  attainments.  It  is  a  very  much  more  difficult  task 
to  follow  up  each  case  and  find  out  what  the  score  means.  Until,  however, 
we  can  ascertain  this  meaning  of  the  results  of  tests,  it  is  going  to  be  difficult 
to  interest  teachers  in  the  use  of  tests  for  improvement  of  teaching.  If,  on 
the  other  hand,  we  can  guide  teachers  in  the  diagnosis  of  individual  cases, 
tests  will  immediately  take  on  a  new  significance. 

As  a  first  example  of  analysis,  let  us  consider  a  case  worked  out  by 
Professor  W.  S.  Gray.  He  found  a  boy  who  was  failing  in  fourth  grade 
reading.  The  cause  was  the  boy's  failure  to  begin  at  the  beginning  of  a  line 
and  systematically  follow  the  words  and  phrases  to  the  end.  He  rambled 
inside  of  the  line. 

A  like  example  is  to  be  found  in  the  unsatisfactory  method  which  some 
adults  use  in  adding  a  long  column  of  figures.  They  ramble  around  looking 
for  easy  combinations  and  lose  some  of  the  digits  or  repeat. 

In  the  high  school  subjects  there  are  examples.  Pupils  fail  in  geometry 
because  they  try  to  hold  the  propositions  by  memorizing,  while  in  one  of  the 
other  subjects,  such  as  history,  they  learn  by  a  better  method  and  become 
interested  in  explanations. 

In  Latin  tests  it  is  shown  that  the  third  year  course  is  very  defective. 
The  reason  for  this  is  to  be  found  partly  in  the  inappropriate  subject-matter 
presented  in  the  third  year,  partly  in  the  vocabulary  method  of  translation 
acquired  by  pupils  in  the  earlier  years. 

Defective  methods  are  in  some  eases  due  to  the  continuation  in  the  later 
stages  cf  a  subject  of  a  method  cf  work  which  was  all  right  at  first,  but  is 
outgrown  and  defective  for  later  stages.  Creeping  is  all  right  in  infancy, 
but  not  in  mat  are  life. 

Again,  analysis  will  often  make  us  aware  of  the  fact  that  training  is 
dealing  with  mental  powers  which  have  nothing  to  do  iirectly  with  the 
subject-matter  of  a  course.  Adding  a  long  column  of  figures  requires  a 
power  of  sustained  attention  as  well  as  knowledge  of  the  addition  tab' 
A  lesson  in  history  demands  training  in  fluent  reading.  If  the  leading  is 
slow  and  defective,  it  w  ill  interfere  with  the  learning  of  the  historical  facts. 

These  examples  show  that  we  must  go  behind  the  results  of  tests.  The 
tests  will  show  children  to  be  efficient  or  defective.  Analysis  is  necessary  to 
show  the  reasons  which  lie  back  of  these  test  results. 
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Periods  of  Educational  Development  (Abstract) 


Ch  vrles  H.  Judd 

Am  analysis  of  educational  processes  is  sure  to  concentrate  attention  on 
the  fact  thai  children  have  very  different  types  of  capacities  at  different 
ages.  The  older  child  differs  from  the  younger,  not  only  in  the  amount  of 
information  which  he  possesses,  bu1  also  in  his  modes  of  nervous  and  mental 
action.  A  mature  nervous  system  is  a  network  of  highly  organized  tracts 
and  a  new  impression  coming  into  this  organized  system  will  be  transmitted 
in  a  wholly  different  fashion  from  the  same  impression  entering  into  the 
diffuse  and  little-organized  nervous  system  of  the  younger  child. 

The  genera]  principal  of  periodicity  was  brought  into  educational  literature 
in  a  very  striking  way  by  Hall  thru  his  studies  of  adolescence.  There  are 
fallacies  in  Hall's  treatment  of  the  matter;  perhaps  the  most,  striking  is  his 
contention  that  adolescence  is  a  sudden  and  surprising  something  wholly 
new  and  unrelated  to  the  child's  immediately  antecedent  development.  The 
fact  is  that  adolescence  can  be  understood  only  when  we  trace  the  full 
history  of  the  child's  development. 

The  best  explanation  of  adolescence  and  the  best  basis  for  a  full  under- 
standing of  the  process  thru  which  a  child  matures  can  be  gained  by  the 
study  of  the  changes  which  take  place  in  the  process  of  digestion.  The 
infant  organism  cannot  perform  the  elaborate  secretive  processes  which  are 
necessary  to  digest  solid  foods  and  foods  of  great  variety.  The  glands  of 
the  digestive  tract  constitute  an  elaborate  battery  of  chemical  stations  and 
these  glands  can  be  brought  under  control  only  thru  gradual  use  and  adapta- 
tion to  each  ol  her.  While  this  process  of  coordination  is  going  on  the  infant 
can  digest  only  simple,  predigestcd  foods.  The  appearance  of  teeth  and 
the  slow  growth  of  power  to  master  the  chemical  complexities  of  digestion 
mark  the  arrival  of  the  child  at  the  advancing  stages  of  maturity.  Adoles- 
cence with  all  its  expressions  of  maturity  is  the  outcome  of  a  long  series  of 
earlier  adjustments  on  the  physical  side.  The  adult  organism  requires  strong- 
food,  and  the  organism  cannot  make  its  last  adult  growth  until  the  prob- 
lems of  digestion  have  been  solved. 

The  analogy  of  digestion  carries  us  over  into  the  field  of  psychology. 
Here,  too,  there  is  a  series  of  facts  which  show  slow  development.  The 
first  grade  child  cannot  include  in  a  single  act  of  attention  very  many  ele- 
ments. The  first  grade  child  has  no  discriminating  view  of  himself  as  dis- 
tinguished from  the  rest  of  the  Avorld.  The  first  grade  child  does  not  have 
the  power  to  critically  judge  what  is  true  and  false.  He  must  develop 
gradually  thru  many  trials  in  the  course  of  which  he  tries  to  adjust  himself 
to  other  people  and  to  the  physical  world  about  him. 
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The  outline  of  a  scheme  of  periodicitj  which  will  be  helpful  in  con- 
structing the  school  curriculum  is  as  follows:  Primary  pupils  are  imitative, 
they  have  nol  established  a  high  degree  of  self-assertiveness,  they  are  readily 
led  by  the  teacher  and  will  readily  acquire  the  fundamental  social  arts, 
especially  reading. 

The  pupils  <>f  the  fourth,  fifth,  and  sixth  grades  arc  highly  self-assertive; 
they  arc  mil  especially  interested  in  social  example.  They  require  a  greal 
variety  of  objective  information  to  satisfy  their  personal  interests. 

The  junior  high  school  period  is  a  period  of  social  interest,  w  holly  differenl 
from  the  primary  period.  The  pupil  is  no  longer  imitative  I'm-  he  has  passed 
thru  the  fourth,  fifth,  ami  sixth  grades,  w  here  he  has  cultivated  a  high  degree 
of  self-consciousness.  The  junior  high  school  period  is  one  cf  self-conscious 
desire  to  know  society.  The  social  sciences  are  then  appropriate  subjects 
for  the  training  of  pupils  of  tins  period. 

The  senior  high  school  period  is  one  of  partial  specialization. 

Without  attempting  to  defend  the  foregoing  as  the  only  possible  descrip- 
tion of  the  maturing  process,  it  may  safely  be  asserted  that  some  such  outline 
must  be  arrived  at  as  the  basis  of  the  course  of  study.  The  evolution  of 
American  schools  has  brought  us  to  the  point  where  we  are  going  to  give 
each  pupil  ample  training.  The  selection  of  subjects  for  the  schools  is  no 
longer  limited  to  the  few  rudimentary  subjects.  We  are  now  in  a  position 
to  organize  an  elaborate  course  if  we  can  discover  the  right  principles  of 
organization.  The  principle  of  organization  which  is  here  advocated  as 
highly  important  is  the  principle  of  periodicity. 


An  Efficient  Method  for  Measuring  the  Results 
of   Instruction  in  Colleges  and  Schools 


William  P.  Book 

I.    An     Efficient     Method     for    Measuring     School     Accomplishment 

Denned 

Two  methods  may  be  used  for  measuring  the  school  accomplishment  of  a 
particular  pupil  or  class,  and  the  success  achieved  by  a  teacher  or  school: 
i  1  i  By  the  use  of  standards  set  by  the  world  and  determined  by  a  study  of 
the  school  accomplishment  of  a  large  group  of  unselected  individuals.  This 
gives  a  sort  of  normal  standard  of  achievement  with  which  to  compare  the 
accomplishment  of  a  particular  individual  or  group.  By  this  method  and  by 
the  use  of  such  world  standards  the  school  accomplishment  of  pupils  and  the 
success  of  teachers,  classes,  and  schools  have,  as  a  rule,  been  measured  in 
total  disregard  of  the  native  mental  endowment  of  the  pupils  whose  scholastic 
achievement  is  being  evaluated.  The  ability  of  the  pupils  to  Learn,  or  achieve 
scholastic  success,  has,  as  a  rule,  not  been  taken  into  account  in  our  educa- 
tional measurements.  (2)  .\  second  and  more  pedagogical  method  for 
measuring  the  school  accomplishment  of  a  given  pupil  or  class,  and  therefore 
the  success  of  a  teacher  or  school,  is  by  the  use  of  standards  and  norms  w  hich 
take  into  account  the  native  mental  endowment  of  the  pupils  with  whom 
the  teacher  or  superintendent  must  deal,  measuring  achievement  in  school 
and  the  success  of  teaching  in  terms  of  w  hat  may  reasonably  be  expected 
in  the  way  of  scholastic  accomplishment  from  pupils  who  possess  their 
particular  type  and  grade  of  ability.  If  we  wish  to  evaluate  the  progress  in 
school  thai  can  or  should  be  made  by  a  particular  pupil  or  class,  their  native 
mental  endowment  must  in  all  justice  and  For  the  sake  of  accuracy  be  taken 
into  account.  In  no  other  way  can  we  determine  what  ought  to  be  achieved 
or  demanded  in  school  from  such  an  individual  or  group.  This  is  the  true 
pedagogical  method  and  should  be  used  by  all  teachers  in  dealing  with  in- 
dividual students  or  classes;  and  by  superintendents  in  evaluating  the  work 
of  a  particular  teacher  or  school  or  when  comparing  the  results  obtained  in 
his  own  system  with  the  accomplishment  of  another  system  in  a  neighboring 
city  or  state.  For  the  latter  may  contain  pupils  possessing  a  very  different 
grade  of  native  mental  endowment  from  that  possessed  by  the  pupils  with 
w  horn  he  must  deal  and  work. 

In  deciding  what  can  or  ought  to  be  done  for  a.  particular  individual  or 
class  or  for  individuals  who  vary  so  tremendously  in  native  mental  endow- 
ment as  do  Hie  pupils  of  any  class,  community,  or  school,  we  need  a  method 
for  measuring  their  accomplishment  in  school  which  will  take  into  account 
the  native  mental  endowment  of  each  pupil  or  group,  instead  of  a  standard 
which  is  only  applicable  to  a.  theoretically  average  individual  or  which  is 
demanded  by  the  world.  Such  world  standards  and  the  met  hods  of  measure- 
ment based   upon   them  are  still  helpful  for  purposes  of  educational   and 
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vocational  guidance,  but  they  are  wholly  useless  as  a  m  3howing  whal 

may  reasonably  be  expected  in  the  way  of  school  accomplishmenl  from  a 
particular  individual  or  group.  They  show  whal  degree  of  accomplishmenl 
musl  be  achieved  by  an  individual  it'  he  is  to  be  successful  in  a  given  line  of 

work  or  if  he  is  i ake  normal  or  unusually  rapid  progress.     They  arc. 

therefore,  valuable  for  certain  purposes,  bul  such  a  method  can  never  be 
used  as  a  just  or  accurate  method  for  measuring  the  school  accomplishment 
of  pupils  or  to  evaluate  the  success  of  a  superintendent  or  teacher  because  it 
fails  to  measure  what  is  being  achieved  in  the  lighl  of  what  actually  can  or 
ought  to  !'•  accomplished  by  individuals  or  groups  \\  ho  vary  so  |  remendoush, 
in  ability  to  learn.  Such  a  true  pedagogical  nut  hod  for  evaluating  school 
achievement  is  a  necessary  instrument  for  any  teacher  or  superintendent 
\\  ho  desires  to  conserve  and  cu!li\  ate  to  t  he  fullesl  extent  the  capacil  tes  and 
talents  of  all  his  pupils. 

II.    Need  lor  a    More   Just    and    Efficienl    Method    of    Measuring   Ac- 
complishment in  School 

Some  of  the  reasons  why  such  a  pedagogical  method  should  be  used  to 
measure  the  progress  of  pupils  in  school  and  the  success  achieved  by  a 
teacher  or  superintendent  should  perhaps  be  pointed  out  in  detail.  First 
and  foremost  of  these  is  the  fact  of  the  marked  individual  differences  in 
ability  to  learn  and  do  which  we  find  when  we  compare  individuals  belonging 
to  any  homogeneous  group  or  to  similar  groups  in  different  communities  and 
schools.  The  native  mental  endowment  of  pupils  belonging  to  different 
classes  in  the  same  school  system  or  to  schools  located  in  the  same  county  or 
township  varies  tremendously.  Three  years  ago  we  made  a  mental  survey 
of  all  the  schools  in  one  Indiana  county  and  found  a  rural  school  in  one 
township  where  19  pupils  were  present  on  the  day  the  tests  were  given;  11  of 
this  number,  or  56  per  cent,  were  feeble-minded.  Twenty  per  cent  of  the 
seh  >1  population  of  the  entire  township  were  found  by  individual  examina- 
tion to  be  feeble-minded.  In  another  township  11  per  cent  of  all  pupils 
present  in  school  on  the  day  the  tests  were  given  were  feeble-minded.  In  a 
t  hird  tow  nslnp  less  t  han  2  per  cent  of  t  he  total  school  population  was  feeble- 
minded. It  should  be  added  that  this  is  perhaps  a  'cry  unusual  case,  hut 
it  makes  clear  the  fad  thai  the  scho<  1  accomplishmenl  in  township  7  where 
less  than  2  per  cent  were  feeble-minded  eannol  in  justice  be  compared  with 
the  results  obtained  by  teachers  in  township  I  where  l  pupil  out  of  everj  5 
feehle-minded.1  We  need  a  standard  for  measuring  school  accomplish- 
menl which  will  enable  us  to  determine  whal  may  reasonably  be  expected 
from  and  what  should  he  done/-/'  pupils  who  differ  so  widely  in  native 
mental  ability. 

In  our  state-wide  mental  survey  of  high  school  seniors  we  found  differ- 
ences in  i he  native  mental  endow  men t  of  the  senior  classes  representing  in- 
dividual high  schools  which  were  equallj  marked,  even  when  these  schools 
were  of  the  same  si/.e.  and  located  in  the  same  county,  township,  orcity.2 
This  fact  is  strikingly  shown  in  Figure  I  which  represents  the  senior  classes 


'Compare  stud]  bj  \\  r.  Book,  "Variations  in  Mental  Ability  and  its  Distribu- 
tion among  the  School  Population  <>!'  an  indiana  Count]  "  Proceedings  of  fifth 
Annual   Conference  en    Educational    Measuremen  iana    i  Diversity,    Bulletin  of 

tin-  Extension  Division,  Vol.  IV.  No.  i. 

impare  stud]  by  W.  !•'.  Booh  en  "The  Intelligence  of  High  school  smim-s" 
published  bj  tin'  Macmillan  Co.,  November,  rai'i .  :!.">()  pp.  See  especially  Chapter 
XII.     Their  courtesj   for  the  use  ol    h         Igures  is  gratefullj  acknowledged. 
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For  L918-19  in  ;ill  the  high  schools  of  t he  state  ranked  3.  It  shows  the  per- 
centage  of  pupils  belonging  to  each  senior  class  who  made  the  highest  (A  or  B) 
and  the  lowesl  I).  E,  or  F)  intelligence  rankings  found  among  high  school 
seniors  in  the  entire  state,  and,  as  may  readily  be  seen,  the  differences  in 
mental  endowmenl  of  these  -en  ior  classes  are  strikingly  great. 

Figure  2  compares  the  native  menial  endowmenl  of  the  senior  classes  in 
the  firsl  26  schools  of  rank  6.  The  90  schools  in  the  state  belonging  to  this 
rank  were  arranged  in  alphabetical  order  ami  the  first  26  schools  taken  to 
show  i he  variations  in  intelligence  found  among  their  senior  classes.  1  'la- 
figure  shows  the  per  cent  of  seniors  who  made  an  A  or  B  ranking  on  the 
mental  te>t>  and  the  percentage  ranking  I).  E,  or  F.  In  some  of  these 
schools   I  he  ent  in-   senior  cla>s    made   scores   which    placed  them  above  the 
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I'n..  ::.     Scores   made  by  middle  50  per  eenl   of  the  seniors  in  each   high 
school    ranked   3. 


median  for  the  entire  stale  while  in  oilier  schools  the  entire  senior  class 
ranked  below  the  state  median.  Differences  equally  as  greal  as  those 
shown  in  this  chart  would  appear  it  the  [as1  or  middle  26  schools  belonging 
to  this  rank  had  been  selected  for  the  comparison,  or  if  wi  had  compared 
the  intelligence  ratings  of  the  middle  50  per  cent  of  seniors  belonging  to 
each  of  these  schools.     (See  Figures  •'!  ami   i 


99 


Bulletin  of  the  Extension  Division 


INTELL 


GRADES 


E- 


I) 


c-    c     c 


8 


A       A^ 


Fig.  I.  Scores  made  by  middle  ."iii  per  cent  of  the  seniors  belonging  to 
the  first  26  schools  of  rank  •'..  Figures  at  right  of  the  bars  arc  key 
letters  ;iinl  refer  id  individual  schools. 


Similar  differences  appear  if  we  compare  schools  of  the  same  size  and 
rank  located  in  the  same  county  or  city.  Figure  5  compares  all  the  high 
schools  located  in  four  Indiana  cities  A,  B,  C,  and  D.  The  rank  or  size  of 
the  schi ols  is  indicated  by  the  figures  placed  on  the  vertical  bars,  representing 
the  several  individual  schools.  It  will  be  seen  from  an  examination  of  tins 
figure  that  the  senior  classes  in  cities  A  and  C  show  a  marked  difference  in 
native  mental  endowment;  the  two  schools  in  city  D  are  about   equal  in 
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mentaJ  strength;  two  of  the  three  high  schools  in  eitj  B  are  about  equal  in 
native  mental  ability,  while  the  third  school  ranks  much  higher  in  the  per- 
centage  of  seniors  who  belong  to  the  highesl  intelligence  ranks. 
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I'h..  5.     Per  cent  nf  seniors  in  the  high  schools  of  four  cities  (A,  1'..  C,  and 
l»i    wlm  made  tin'  highesl    (A   or   B)   and   lowesl    <l».   E,  or   F)    intel 

ligence   rating  on  the  tevi<. 

The  same  variability  in  native  mental  endow  menl  is  sliow  n  it  we  compare 
schools  in  the  same  county.  Figure  6  compares  the  senior  classes  cf  all  the 
high  schools  tested  in  three  Indiana  counties,  selected  at  random  from  the 
92  counties  of  the  state.  The  figures  placed  above  the  vertical  bars  indicate 
the  rank  of  the  schorl.  The  length  of  the  black  bar  above  the  horizontal 
line  shows  the  percentage  of  seniors  belonging  to  the  school  who  made  the 
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highest  mental  rating  obtained  by  any  high  school  seniors  in  the  state,  while 
the  distance  below  the  horizontal  bar  indicates  the  proportion  of  seniors  in 
the  school  who  obtained  the  lowest  (D,  E,  or  F)  mental  rating  made  by 
high  school  seniors  in  the  slat''.  It  w  ill  be  seen  that  the  schools  in  county  F, 
if  considered  as  a  whole,  arc  decidedly  superior  to  the  schools  tested  in 
comity  C  The  same  remarkable  variations  from  school  to  school  are  shown 
if  we  compare  the  schools  in  any  county. 
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Fig.  G.  Per  cent  of  seniors  representing  individual  high  schools  in  three 
counties  (E.  F.  and  <;i  who  made  the  highest  A  or  15  and  lowest 
D,  E,  or  F  intelligence  ratings  on  the  tests. 

ll  would  clearly  he  unjust  to  both  pupils'and  teachers  to  expect  the  same 
quality  or  amount  of  school  work  from  senior  classes  which  differ  so  widely 
in  native  mental  endowment.  In  fact,  it  would  be  impossible  to  get  the 
same  scholastic  results  in  these  several  schools. 

A   second    reason    why   a    more    pedagogical    method    should    be    used    to 

measure  the  accomplishment   of  children   in  scl 1   is  that    in  no' other  way 

••an  wo  determine  what,  may  reasonably  be  expected  from  or  done  for  pupils 
who  vary  so  greatly  in  native  mental  endowment.  A  comparative  studj  of 
the  intelligence  scores  and  school  accomplishment  of  pupils  in  the  public 
schools  and  colleges  has  shown  that  it  is  ab  a  rule  the  most  capable  individuals 
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who  are  reallj  retarded  and  therefore  most  poorly  served  by  the  school 
because  they  arc  encouraged  by  our  presenl  methods  of  evaluating  their 
work  to  do  les>  than  their  best.  In  other  words,  we  are  no1  getting  returns 
from  our  brightest  students  commensurate  with  their  ability.  They  are 
often  made  to  feel  by  our  presenl  met  hods  of  evaluating  school  accomplish- 
ment thai  they  are  doing  very  well  when  they  are  doing  only  a  little  better 
than  average  work,  when  because  of  their  exceptional  ability  they  should 
be  doing  a  very  superior  grade  of  work.  Students  who  possess  a  more  medi- 
ocre grade  of  ability  are.  on  t he  o1  her  hand,  often  found  to  be  advanced  more 
vapidly  than  would  be  normal  for  I  hem.  And  because  they  do  a  poor  grade 
of  work  when  compared  with  their  superior  classmates  they  often  become 
discouraged,  and  paralyzed  in  their  efforts  because  they  are  nol  told  or 
shown  that  they  are.  in  reality,  doing  a  very  commendable  grade  of  work 
for  them.  As  a  result  of  such  methods  of  evaluation  many  of  the  brightest 
students  in  our  colleges  and  schools  are  really  encouraged  to  form  habits  of 
work  far  bekro  the  level  of  then-  best  achievement,  while  extra  time  is  spent 
on  the  duller  students  who  are  already  doing  a  fair  or  superior  grade  of 
work  when  we  take  into  account  their  native  mental  endowment.  There  is 
great  human  waste  because  we  try  to  bring  the  dull  up  to  standards  of 
achievement  which  are  clearly  impossible  for  them,  while  the  more  gifted 
students  are  allowed  to  form  habits  of  mental  laziness  because  they  are  not 
given  the  kind  of  guidance  and  help  which  their  superior  ability  requires. 

A  few  facts  should  be  given  in  support  of  this  statement.  In  our  state- 
wide mental  survey  of  high  school  seniors  a  careful  study  was  made  of  the 
intelligence  rankings  of  all  high  school  seniors  in  the  state  who  had  been 
accelerated,  normalky  promoted,  or  retarded  in  high  school  and  at  some 
time  during  then-  elementary  school  course.  This  study  revealed  the 
astounding  fact  that  the  brightest  seniors  in  the  state  were  never  selected 
for  special  advancement  either  by  the  high  school  or  in  the  elementary 
grades.  Seniors  with  a  high  average  or  slightly  superior  grade  of  intelligence 
as  high  school  seniors  go  were  often  advanced  more  rapidly  than  normal, 
but  none  of  the  seniors  whose  intelligence  score  placed  them  in  the  high 
one  percentile  group  for  the  state  were  found  in  any  of  the  accelerated  groups. 
These  more  gifted  individuals  either  had  not  been  located  by  the  school,  or 
if  located,  they  had  not  been  permitted  to  complete  their  course  in  less  than 
normal  time.  Of  the  seniors  who  possessed  an  A+  or  A  grade  of  mental 
ability  only  6  and  7  per  cent  respectively  were  advanced  more  rapidly  than 
normal  in  high  school,  while  91  and  90  per  cent  of  these  most  superior  students 
were  only  normally  advanced.3 

Our  study  further  showed  that  most  high  school  seniors  who  possessed 
the  most  inferior  grades  of  intelligence  found  among  high  school  seniors 
(93  to  (»7  percent)  had  been  regularly  promoted  in  high  school,  while  less 
than  (>  per  cent  of  our  total  group  finished  their  high  schoi  1  course  in  less 
than  normal  time.  Our  results  therefore  clearly  show  thai  the  schools  ;ire 
not  adapting  themselves  to  the  native  mental  abilities  of  their  students  as 
well  as  they  should;  that  they  arc  accelerating  too  few  students;  and  that 
the  school  officials  are  unable  to  select  the  most  intelligent  student--  tor  such 
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special  advancement  or  to  induce  them  to  do  the  quality  of  work  which  is 
commensurate  with  their  ability. 

Summarizing  the  results  of  our  entire  study  on  this  point  we  found  that 
more  than  twice  as  many  students  were  kept  on  their  high  school  course 
four  years  as  possessed  an  average  grade  of  intelligence  for  high  school  seniors; 
about  seven  times  as  many  possessed  a  superior  grade  of  intelligence  as  were 
actually  permitted  to  shorten  their  course,  while  less  than  one-third  of  the 
group  possessing  very  inferior  grades  of  intelligence  were  actually  retarded. 
We  maj  conclude  thai  many  students  in  our  schools  are  working  far  below 
the  level  of  their  besl  attainment  and  so  acquiring  habits  of  laziness  and 
inefficiency  because  their  school  work  is  ill  adapted  to  their  mental  strength 
and  needs.  The  remedy  would  seem  to  lie  in  a  method  of  evaluating  school 
achievemenl  in  terms  of  mental  capacity  or  ability  to  learn;  to  apply  in  all 
our  educational  work  the  principle  set  forth  by  the  Great  Teacher  in  His 
parable  of  the  talents.  In  no  other  way  can  the  capacities  of  our  students 
be  fully  conserved  and  the  work  of  the  school  made  truly  economical  and 
efficient. 

Similar  facts  have  been  revealed  by  our  study  of  the  intelligence  ratings 
and  scholastic  records  made  by  college  students  and  children  in  the  ele- 
mentary grades  of  the  public  schools.  Last  October  Mrs.  Pressey,  research 
fellow  in  psychology,  made  a  special  study  of  the  school  accomplishment  in 
arithmetic  of  two  fourth  grade  classes  in  the  Bloomington  schools.  The 
actual  progress  made  in  the  fundamental  processes  of  arithmetic  was  com- 
pared with  the  pupils'  actual  ability  to  master  this  work.  It  was  found  that 
only  a  low  degree  of  correlation  existed  between  ability  to  do  this  work  and 
their  actual  achievement  in  school;  the  coefficient  of  correlation  was  only  .'_'s. 
A  careful  analysis  of  the  individual  records  showed  that  the  lack  of  correlation 
was  due  chiefly  to  the  fact  that  the  brightest  students  had  fallen,  in  their 
achievement,  far  below  the  point  which  their  native  mental  ability  indicated 
that  they  should  attain.  By  carefully  measuring  the  school  achievement  of 
each  of  these  pupils  and  representing  t  he  results  on  a  card  m  a  manner  which 
would  picture  to  each  pupil  his  actual  scholastic  accomplishment  in  terms 
of  what  should  be  achieved  and  showing  him  in  which  particular  respects 
his  record  was  below  what  it  should  be  and  at  what  points  it  was  normal  or 
high,  and  by  presenting  such  records  to  these  children  at  intervals  of  two 
weeks  for  a  month  and  a  half,  tin-  achievement  of  the  brightest  students  in 
the  class  was  sufficiently  raised  to  increase  the  coefficient  of  correlation 
between  school  attainment  and  their  mental  test  scores  from  .28  to  .85.  For 
the  control  group  in  the  same  grade  and  school  no  such  results  were  obtained. 
The  coefficient  of  correlation  was  increased  only  10  points,  from  .35  to  .45. 
Not  only  was  the  school  record  of  t  lie  brightest  students  thus  materially 
raised  and  these  pupils  shown  what  they  really  should  accomplish,  but  the 
le>s  fortunately  endowed  members  of  the  class  were  for  once  in  their  life 
proud  of  their  achievement.  As  (die  of  them  enthusiastically  remarked: 
"This  is  about  the  first  time  in  my  life  that  I  have  been  told  I  was  doing  well 
m  school."  But-  what  is  perhaps  still  more  significant-,  the  most  superior 
members  of  the  class  wore  for  the  first  time  in  their  life  forcefully  reminded 
of  the  fact  that  they  were  not  doing  as  well  as  they  ought  to  do.  These 
brighter  children  had  been  well  satisfied  with  their  record  in  school  until 
they  received  the  first  report  of  the  experiment.     They  had  always  stood  at 
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the  head  of  their  class  and  would  have  received  no  particular  encouragement 
i.i  ill   better  work  From  the  old-fashioned  report. 

A  similar  situation  has  been  revealed  by  a  study  of  the  scholatic  records 
made  bj  300  college  students  evaluated  in  terms  of  their  intelligence  ratingo 
obtained  by  giving  the  Indiana  University  Intelligence  Scale.  Our  resu 
(dearly  show  that  it  is  as  a  rule  the  brightesl  students  who  are  doing  less  than 
they  are  able  to  do.  In  evaluating  the  scholastic  record  of  these  -indents 
the  principle  set  forth  in  the  parable  of  the  talent,  should  as  far  as  possible 
be  applied  in  every  individual  case  and  their  school  accomplishment  measured 
in  terms  of  what  they  are  really  able  tc  do.  This  is  the  only  method  thai  is 
accurate  and  just  and  the  only  way  in  which  these  students  may  be  helped 
according  to  their  needs. 

III.      How    the  Work  of  a  Pupil,  Teacher,  or  School  may  be  Measured 

in  this  More  Accurate  and  Pedagogical  Way 

For  more  than  a  year  we  have  been  making  a  study  of  the  scholastic 
success  attained  in  college  by  the  brightest  seniors  who  graduated  from  the 
high  schools  of  the  state  in  1919,  and  have  given  some  attention  to  devismg 
a  technique  which  would  enable  us  to  measure  such  scholastic  success  in 
terms  of  their  native  mental  ability  to  do  the  work.  Tt  is  obvious  that  we 
cannot  measure  the  school  accomplishment  of  students  in  terms  of  their 
ability  unless  we  combine  the  results  from  a  mental  survey  with  the  results 
obtained  from  the  most  reliable  measurement^  we  can  make  of  the  school 
achievement  of  the  particular  individuals  or  groups  whose  scholastic  ac- 
complishment we  desire  to  evaluate.  A  careful  mental  survey  must  be 
made  and  the  results  studied  in  relation  to  the  most  accurate  measure  we 
can  get  of  the  school  accomplishment  of  our  group. 

In  devising  such  a  pedagogical  method  of  measurement  it  would  be 
desirable  if  an  accomplishment  quotient  or  index  of  learning  ability  could  he 
obtained  which  would  indicate  the  relation  which  exist-  between  a  student's 
native  mental  endowment  or  ability  to  learn  and  his  actual  scholastic  success. 
If  such  an  achievement  quotient  or  learning  index  were  devised  it  could  be 
used  to  determine  what  a  student,  with  a  given  grade  of  ability,  could  and 
therefore  should  be  expected  to  accomplish  in  school. 

In  the  earlier  stages  of  cur  mental  measurement  work  it  was  thought  that 
a  reliable  intelligence  score  really  constituted  such  a  measure  of  accomplish- 
ment. As  a  result,  intelligence  ratings  have  often  been  used  as  a  guide  in 
the  promotion  of  pupils  in  school,  as  a  Kst  for  admission  to  college,  and  in 
main-  universities  as  a  basis  for  awarding  scholarships  and  fellowships  to  the 
most  capable  students.  But  careful  studies  have  shown  that  other  factors 
besides  intelligence  enter  into  the  making  of  a  successful  record  in  school 
and  life:  that  quite  as  much  depends  upon  the  individual's  attitude,  his 
application  and  interest  in  the  work,  his  interest  in  his  own  success  and  im- 
provement as  upon  his  intelligence  or  mere  ability  to  do.  These  studies  ha 
made  it  very  clear  that  we  do  not  yet  have  any  reliable  method  for  deter- 
mining w  hat  success  a  given  student  w  ill  attain  m  school  or  life  and  thai  the 
problem  of  obtaining  such  an  achievement  quotient  is  exceedingly  difficult 
and  complex.  Nevertheless,  it  is  important  to  evaluate  as  far  as  we  can  «  ha1 
a  pupil  does  in  college  or  school  in  terms  of  w  hat  he  is  really  able  to  do  and  to 
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devise1  the  besl   standards  and  methods  we  can   Invent  for  measuring  the 
results  of  our  teaching  in  this  true  pedagogical  way. 

Guiding  Principles.  In  attempting  to  devise  such  a  standard  and  method 
for  evaluating  school  accomplishment  we  have  kept  in  mind  the  following 
principles  and  aims: 

1.  Students  should  be  shown  no1  only  what  they  arc  actually  accom- 
plishing but  what  they  arc  really  able  to  do  so  far  as  this  may  be  indicated 
by  a  mental  test  score  supplemented  by  teachers*  estimates  of  their  ability. 
They  should  be  given  reports  showing  not  merely  what  they  have  achieved 
but  what  they  are  able  to  achieve  so  that  they  may  have  a  definite  goal 
toward  which  to  work,  a  goal  which  they  could  actually  attain  if  willing  to 
u  ork 

2.  The  report  should  be  sufficiently  diagnostic  in  character  to  show 
each  student  in  what  particular  subject  he  is  below,  al,  or  above  the  standard 
of  achievement  which  is  Hernial  for  him. 

•*->.     The  method  must  be  accurate    t  horoly  practical,  and  just  to  the  pupil. 

4.  The  report  should  be  so  worked  out  and  presented  thai  it  would 
encourage  the  student  and  stimulate  him  to  do  bettei   work. 

5.  The  report  should  be  presented  in  a  wav  that  the  practical  value  of 
setting  such  a  definitely  attainable  goal  before  the  student  could  he  measured 
and  the  degree  to  which  it  stimulated  him  l.)  do  better  work  accurately  de- 
termined. 

6.  Comparison  should  be  made  with  his  own  class,  or  group,  rather  than 
w  it  h  standards  which  are  more  fixed  in  character  or  universal  in  application. 

Method  Described.  With  these  principles  in  mind  a  new  form  of  report 
card  was  devised  whi'-h  it  was  thought  might  accomplish  most  or  all  of  these 
purposes.  Seven  University  classes,  300  students,  were  given  the  Indiana 
University  Intelligence  Tests  and  the  range  in  mental  rating  made  by  each 
class  determined.  The  median  and  ."">  percentile  scores  for  each  class  were 
next  determined  and  the  results  represented  on  5  x  8  cards  in  such  a  manner 
that  the  median  score  tor  the  class  and  the  individual  score  made  on  the 
test  by  each  student  was  shown  in  its  appropriate  relation  to  the  ratings 
made  by  the  entire  class.  To  accomplish  tin.-,  the  card  was  divided  verti- 
cally into  "JO  equal  parts,  each  part  representing  the  range  in  menial  test 
score  made  by  each  5  percentile  group,  ranging  from  the  lowest  or  .">  per- 
centile group  to  the  highest  or  (.).">  percentile  group.  Each  individual's  in- 
telligence score  was  then  represented  on  the  student's  individual  report  card 
in  its  appropriate  place  in  this  total  range  of  mental  ratings. 

The  card  was  divided  vertically  on  its  right,  hand  side  into  1'2  equal 
divisions,  representing  the  various  scholarship  ratings  given  to  students  in 
their  college  subjects  at  the  end  of  the  semester.  The  card  was  next  divided 
horizontally  into  7  equal  divisions,  and  the  .scholastic  achievement  attained 
in  each  subject  as  indicated  by  the  professor's  term  marks  represented  on 
these  vertical  lines  at  the  points  indicating  1  he  scholastic  rating  actually 
attained  in  those  subjects.  The  scholastic  standing  in  each  subject  was 
therefore  show  n  for  each  student  in  relation  to  his  own  mental  rating,  and  in 
relation  to  the  median  ability  of  the  class.  These  points  were  then  con- 
nected by  a-  solid  black  line,  and  the  average  scholarship  in  all  subjects  de- 
termined by  calculating  on  a  credit  hour  basis  the  percentage  which  each  stu- 
dent   obtained    in    all    subjects   studied    during   the   semester.      This  average 
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scholarship  rating  was  indicated  l>.\  a  dotted  horizontal  line  on  the  card. 
Such  individual  reporl  cards  were  prepared  and  given  to  the  instructors  and 
in  each  member  i  t'  the  class.  Tin  \  showed  the  median  score  for  the  class' 
the  individual's  own  mental  rating,  his  average  scholarship  rating,  and  his 
actual  accomplishment  in  each  subjeel  studied  during  the  semester  as  in- 
dicated by  the  marks  given  him  by  his  pr<  fessors  a1  the  close  of  the  term. 
Si  .    sample  report  card  in  Figures  7  to  1<>  below  . 

These  individual  report  cards  were  then  presented  to  the  students  with 
the  request  that  they  lie  carefully  studied  and  that  they  explain  a-  far  as 
possible  an.\  discrepancy  which  mighl  appear  in  their  individual  records 
between  their  college  accomplishmenl  as  indicated  by  their  term  marks,  ami 
their  relative  standing  on  the  mental  tests.  'Two  groups  of  college  -indents 
were  studied:  137  juniors  and  seniors  in  the  experimental  psychology  classes 
and|127  sophomore  students  taking  the  course  in  elementary   psychology. 

A  careful  examination  of  all  these  report  cards  showed  thai  a  greal  many 
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Fio.  7.     Record  of  very   superior  student    whose  scholastic  rating  is  very 
low. 


students  made  a  scholarship  record  which  was  much  below  the  achievement 
which  their  mental  test  sc<  re  indicated  they  should  attain.  (See  Figure  7.) 
This  was  particularly  true  for  the  sophomore  students  who  are  taking  the 
required  work,  and  for  the  brightest  students  in  the  several  classes.  Some 
students  did  better  in  i  heir  college  work  than  one  mighl  have  expected  from 
1  heir  mental  tesl  scores.  That  is  In  say  their  scholarship  line  was  above  the 
line   indicating   their  relative   standing  on    the   mental   lest.       (See    Figure  s.  I 

Other  students  made  scholarship  records  which  corresponded  very  closely  to 
the  achievement  which  one  mighl  expect  from  the  relative  standing  on  the 
mental  test.     (Si  e  Figures  9  and  10. 

In  unUr  in  determine  the  cause  or  causes  for  thes<    discrepancies  from 
the  students  themselves  and   to  ascertain  the  effect  which  such  a  report 
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mighl  have  upon  their  future  aork,  an  added  experiment  was  devised 
which  aimed  to  determine  these  facts.  The  students  were  asked  to  explain 
:'s  specifically  as  they  could  the  cause  or  causes  of  any  discrepancy  which 
might  l>e  shown  in  their  own  case  between  their  mental  ability  as  indicated 
by  their  rating  on  the  mental  tesl  and  (lie  actual  accomplishment  in  their 
ci  [lege  courses.  Thej  were  also  asked  to  slate  in  what  specific  ways,  if  any, 
such  a  report  of  their  college  work  would  benefil  them;  and  told  that  their 
scholarship  records  for  the  present  semester  would  lie  placed  on  these  same 
cards  and  studied  in  relation  to  their  previous  scholastic  records  and  intelli- 
gence score.  In  this  manner  we  hoped  to  gel  some  indication  of  the  actual 
effeel  of  such  reports  upon  a  student's  college  work. 
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Fig.  8.     Record  of  student  of  low  intelligence  rating  who  nevertheless  is 
doing  average  college  work. 
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Fig.  9.     Record  of  student  wiht  low  grade  of  mental  ability  for  college 
students  whose  scholarship  standing  coincides  with  his  mental  ability. 
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Pig.  10.     Record   of   superior 
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i  \  .    ( lonclusions 

Our  conclusions  as  to  the  value  or  effecl  of  applying  this  pedagogical 
standard  of  measurement  may  be  briefly  summarized  somewhal  as  follows: 

(1)  Many  of  the  brightest  students  will  be  informed  probably  for  the 
first  time  in  their  school  career  that  their  achievement  is  not  up  to  their 
bighesl  standard  of  accomplishment  and  so  will  be  stimulated  and  encouraged 
to  do  better  work.  One  student  said  the  record  showed  that  be  should  do 
very  much  better  work,  but  that  be  had  been  told  this  before.  To  many 
students,  however,  ii  comes  as  a  new  and  striking  revelation.  Several  stated 
that  they  had  never  been  shown  in  a  definite  way  what  they  really  should 
accomplish  in  school. 

(2)  It  will  stimulate  all  those  whose  school  accomplishment  is  lielow 
their  ability  index.  This  statement  was  made  by  about  90  per  cent  of  the 
students  and  has  been  borne  out  by  work  done  in  the  elementary  schools. 

(3)  Pupils  possessing  only  average  or  mediocre  grades  of  ability  will 
also  be  encouraged  and  stimulated,  since  main  of  them  will  for  the  first 
time  in  their  lives  be  shown  thai  they  are  in  reality  doing  excellent  work 
even  tho  their  achievement  is  not  up  to  thai  of  the  most  gifted  persons  in 

t  heir  class. 

The  method  will  enable  us  to  study  the  causes  of  success  and  failure 
in  school  from  a  new  angle,  and  will  help  to  determine  the  characteristics 
other  than  intelligence  which  enter  into  the  making  of  a  successful  record  in 
school.  When  all  these  characteristics  have  Ween  determined  and  their  im- 
portance demonstrated  they  may  perhaps  be  cultivated  and  assigned  their 
true  place  in  our  scheme  of  education.     W'e  do  noi   need  diagnostic  t> 

w  hidi  will  shew  w  hat  pupils  will  do  in  scl I.  so  much  as  we  need  tests  which 

will  show  what  they  are  really  capable  of  doing  so  thai  we  maj  know  svhal 
in  i  he  way  .if  school  accomplishment  may  reasonably  he  demanded  from 
all  our  si udents. 

.".      Such  a  method  will  also  enable  us  io  measure  the  results  of  instruc- 
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linn  in  a  more  efficient  and  economical  way.  In  evaluating  the  work  of  a 
teacher  we  musl  combine  the  results  obtained  from  achievement  tests  with 
the  results  cf  a  mental  survey  and  learn  to  judge  what  is  being  accomplished 
by  a  particular  individual  or  class  in  the  light  of  what  they  are  really  able 
to  do.  It  is  not  only  unjust,  but  pedagogically  indefensible  to  judge  the 
results  obtained  by  a  teacher  without  regard  to  what  can  and  therefore  what 
ought  to  be  achieved. 

(6)  Such  a  method  of  measurement  will  also  give  us  a  new  technique  for 
studying  retardation.  The  best  and  perhaps  the  only  way  in  which  a  super- 
intendent can  determine  the  extent  to  which  his  schools  and  teachers  are 
succeeding  in  adapting  the  work  to  the  native  mental  endowment  of  their 
pupils  is  by  means  of  a  mental  survey.  This  may  be  done  by  determining 
the  grade  of  intelligence  which  the  pupils  possess  who  have  actually  been 
accelerated  or  retarded  by  the  schools.  The  intellectual  ability  of  those 
accelerated  may  thus  be  compared  with  the  native  mental  endowment  of 
those  who  have  been  retarded  or  only  normally  promoted.  If  the  brightest 
students  are  not  making  good  grades  on  their  school  work  the  reasons  for 
such  failure  should  be  immediately  determined  and  the  proper  adjustment 
made.  The  method  will  also  reveal  whether  the  brightest  students  are 
advanced  as  rapidly  as  their  mental  ability  warrants,  and  whether  or  not  the 
dullest  students  are  promoted  along  with  the  brightest  or  even  ahead  of  them. 
In  schools  where  the  most  careful  mental  surveys  have  been  made  we  regu- 
larly find  that  many  of  the  brightest  students  have  not  been  advanced  by 
the  school  as  rapidly  as  their  ability  seems  to  warrant,  while  the  dullest 
students  have  been  advanced  more  rapidly  than  their  mental  ability  indicates 
that  they  should  be.  In  other  words,  it  is  the  brightest  pupils  who  are 
really  retarded,  because  they  are  found  to  be  from  1  to  2  years  behind  the 
grade  to  which  their  mental  rating  indicates  they  should  belong. 

(7)  Combining  the  results  of  mental  surveys  and  achievement  tests  is, 
therefore,  one  of  the  best  ways  to  measure  the  efficiency  of  an  entire  school 
system.  Mental  surveys  have  revealed  marked  group  differences  between 
classes  or  sections  in  the  same  school  system,  and  between  schools  located 
in  differenl  communities.  The  mental  survey  will  enable  a  superintendent 
first  of  all  to  compare  the  intellectual  capacity  of  different  sections  or  classes 
in  the  same  school  grade  and  so  to  determine  what  in  the  way  of  school 
accomplishment  may  reasonably  be  expected.  In  this  manner  the  work  of 
a  teacher  may  be  properly  evaluated,  when  without  such  intelligence  scores 
all  sections  or  classes  would  be  judged  by  the  same  standard,  which  in  the 
light  of  the  group  differences  which  have  been  shown  to  exist  would  be 
manifestly  inaccurate  and  unjust.  It  is  only  by  the  use  of  mental  tests  that 
a,  superintendent  may  obtain  a  real  factual  basis  for  comparing  the  accom- 
plishment of  his  own  system  with  that  of  another  system  or  to  evaluate  the 
results  obtained  by  the  teachers  in  different  buildings.  Intelligence  tests. 
therefore,  become  not  merely  an  instrument  in  the  hands  of  a  superintendent 
for  making  adjustments  to  class,  school,  and  community  differences,  but  a 
necessary  means  for  making  accurate  pedagogical  measurements  <;f  the 
results  that  are  obtained  in  his  schools. 

(8)  This  method  of  evaluating  school  achievement  will  also,  the  writer 
believes,  make  our  students  more  successful  in  life.  It  will  show  them  while 
still  in  school  more  nearly  what  they  ought  to  accomplish,  and  so  will  help 


Educational  Measurements  33 

to  develop  in  them  habits  of  making  the  tnosl  of  their  abilities.  They  b.av< 
often  been  told  and  urged  to  do  this,  bul  if  such  a  means  of  reporting  the 
success  actually  attained  in  their  work  were  devised  and  u*ri\  thev  would  he 
shown  by  actual  curves  an<l  charts  to  what  extenl  they  arc  really  living  up 
to  the  highesl  level  of  their  ability.  IT  this  matter  is  Left  to  take  care  of 
itself  as  is  at  present  the  case,  manj  of  the  verj  brightesl  students  in  our 
schools  will  form  habits  of  work  far  below  the  besl  level  of  their  achievement 
and  so  hamper  their  chances  for  making  the  highest  possible  success  in  life. 
For  it  may  be  assumed  that  they  will  work-  in  life  aboul  the  uav  they  have 
worked  in  school. 

9  Lastly,  such  a  method  of  reporting  accomplishmenl  in  school  will 
help  to  conserve  to  the  world  the  talents  of  the  brightesl  students  because 
they  will  be  stimulated  to  make  the  most  of  their  capacities  and  talents. 
'Phis  has  already  been  shown  to  he  the  case  in  one  school  grade.  Moreover, 
00  per  cent  of  the  students  whose  college  record  was  studied  believe  that 
such    a    method    of   reporting    their   school    accomplishment    would    produce 

such   ail   effect  . 


\.    S 


ii  m  marv 


Summarizing  in  a  word  the  main  points  of  the  paper,  wre  have  called 
attention  to  two  kinds  of  measurements  in  evaluating  school  accomplish- 
ment: (1)  The  method  which  measures  school  achievement  entirely  on 
the  hasis  of  the  results  obtained,  evaluating  such  results  by  standards  set  by 
the  subject  to  be  mastered  or  by  the  world.  This  method  is  valuable,  among 
other  things,  as  an  aid  for  educational  and  vocational  guidance  because  it 
uses  the  standards  and  achievement  set  by  the  world.  (2)  A  more  accurate 
and  just  method  of  measuring  school  achievement  is  to  evaluate  it  in  terms 
of  the  native  mental  endowment  of  the  learner  or  in  terms  of  what  may 
reasonably  be  expected  from  individuals  or  groups  possessing  a  given  grade 
of  nat  ive  mental  ability.  The  'need  for  such  a  pedagogical  method  of  measure- 
ment arises  from  the  fact  that  we  find  such  marked  individual  differences  in 
native  mental  endowment  among  individuals  and  groups  of  individuals 
located  in  different  communities  and  schools,  and  from  the  fact  that  the 
educational  and  life  needs  of  individuals  who  differ  so  greatly  in  ability 
cannot  he  truly  met  unless  we  know  what  in  the  way  of  school  achievement 
may  reasonably  be  expected  and  therefore  demanded  from  them. 

As  one  possible  method  of  evaluating  school  ac Lplishment  on  the  basis 

of  ability,  we  have  proposed  n  new  type  of  report  card  which  will  show  a 
student's  capacity  to  learn,  as  indicated  by  his  intelligence  rating,  in  relation 
to  the  median,  best,  and  worst  ability  of  a  class  or  group,  also  his  scho<  1 
marks  and  scholarship  standing  in  relation  to  his  ability  to  do  the  work. 
Such  a  report  might  be  used  merely  for  the  information  of  the  superintendent 
and  teacher  or  it  mighl  he  given  to  parents  and  pupils  so  that  each  pupil 
could  see  to  what  extent  he  was  accomplishing  what  might  reasonably  he 
expected  from  him  in  the  way  of  achievement  in  school.  Such  a.  report  would 
reveal  to  the  teacher  what  pupils  were  making  the  most  of  their  capacities 
and  those  who  were  accomplishing  less  than  thej  should.  It  would  also 
enable  a  superintendent  t<   evaluate  more  accuratelj  and  justly  the  work  of 

his  teachers  ami  the  efficiencj  of  his  scl Is.     It  would  tend  to  encouragi 

the  student  vv  ho  is  really  doing  his  besl  hut  who  cannot  attain  the  results  ob- 
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tamed  by  the  most  capable  pupils  in  his  class.  It  would  also  stimulate  those 
who  possess  very  superior  ability,  bu1  who  arc  doing  only  a  good  or  average 
grade  of  work  to  do  superior  work  as  they  should,  and  so  develop  habits  of 
application  and  work  commensurate  with  their  ability,  thereby  conserving  to 
themselves  and  to  the  world  t  heir  superior  endowments. 

On  I  he  basis  of  the  facts  and  data  already  available  and  notwithstanding 
the  many  weaknesses  of  mental  tests  and  the  inaccurate  measures  we  now 
have  for  evaluating  school  accomplishment,  we  may  nevertheless  conclude 
thai  some  such  method  of  reporting  the  school  accomplishment  of  pupils  as 
is  here  outlined  is  worthy  of  being  given  a  serious  trial.  It  is  thoroly  prac- 
tical and  gives  promise  of  yielding  -very  important  educational  results. 

In  eonclusii  n,  I  wish  to  say  t  hat  I  he  cut  ire  problem  raised  is  being  studied 
from  various  angles  by  the  speaker  and  several  advanced  students  in  the 
department  of  psychology.  We  would  be  grateful  for  any  criticisms  of  our 
n.et  hods  and  plans  and  for  any  suggestions  aboul  the  probable  value  of  this 
type  of  research.  We  should  at  any  rate  like  to  hear  the  problem  an.! 
method  fully  discussed. 


Measurement  of  Progress  in  English  in  the 

Upper  Grades 


Sll>\  BY  L.  Pressey 

At  the  conference  last  year,  I  presented  briefly  to  you  the  firsl  form  of  an 
examination  for  investigating  fundamental  achievement  in  the  eighth  grade. 
This  examination,  which  we  have  called  Scale  of  Attainment  No.  2,  consists 
of  tests  in  reading  vocabulary,  the  mechanics  of  English  composition,  Ameri- 
can history,  and  arithmetical  reasoning.  You  have  doubltess  all  seen  the 
blanks,  which  have  been  on  display  along  with  our  other  tests.  It  chanced 
to  come  about  last  fall,  as  the  result  of  a  conversation  with  a  somewhal 
pessimistic-minded  professor  in  another  department,  and  as  a  resull  of 
observation  of  my  own  with  regard  tc  the  shortcomings  of  the  average  college 
student,  that  we  tried  this  scale  for  the  eighth  grade  --  a  scale  dealing  with 
eighth  grade  subjects,  in  an  eighth  grade  way  on  several  classes  here  a1 
Indiana  University.  The  results  were,  in  some  respects,  distressing.  It  is 
surely  unfortunate  that  a  college  student  should  know  the  answers  to  no  more 
than  19  questions  out  of  40,  dealing  with  facts  in  the  history  of  his  country 
considered  sufficiently  important  to  be  put  in  the  eighth  grade  curriculum. 
For  when  we  are  told  that  the  War  of  1812  was  with  Mexico,  that  the 
Louisiana  Purchase  was  made  by  Monroe,  that  the  adoption  of  the  Missouri 
Compromise  was  brought  about  by  Calhoun,  that  the  political  campaign  of 
1896  was  concerned  chiefly  with  reconstruction,  or  that  the  President  of  the 
Southern  Confederacy  was  Andrew  Jackson,  one  cannot  bu1  feel  but  that 
somewhere,  somehow  ,  sometime,  there  is,  or  was,  somel  liing  w  rong.  I  could 
multiply  to  you  examples  of  such  historical  absurdities,  luil  surely  to  no 
great  profit.  In  fact,  I  believe  there  is  an  ancient  pedagogical  law  to  the 
effect  that  a  repetition  of  error  may  lead  to  its  final  acceptance.  And  I  should 
be  most  unhappy  if  I  should  insinuate  into  your  minds  the  idea  that  the 
chief  officer  cf  the  judicial  branch  of  the  government  is  the  President,  that 
the  const  it  utionality  of  acts  of  Congress  is  decided  by  the  Senate,  or  that  the 
Lewis  and  Clark  Expedition  explored  the  Great  Lakes.  I  must  not  leave 
you  with  the  impression,  however,  that  all  the  errors  occurred  in  history. 
The  particular  class  to  which  I  now  have  reference  (made  up  largely  of 
upper  classmen  i  informed  me  that  a  gleaner  works  in  an  asylum,  that  a 
mosque  is  a  kind  of  an  amusement,  that  a  blunderbuss  is  a  kind  of  animal, 
that  a  curfew  is  rung  at  midnight  (perhaps  a  vision  of  things  hoped  for  . 
that  a  sylvan  place  is  found  in  oceans,  that  a  grenadier  is  a  diplomat,  and  that 
a  pathetic  story  is  very  profane.  These  words,  mind  you,  are  all  taken  from 
the  glossaries  of  eighth  grade  readers  and  are  forgotten,  apparently,  soon 
after  the  student  leaves  the  eighth  grade. 

The  mistakes  in  arithmetic  and  in   English  grammar  are  less  dramatic, 
but  no  less  painful.     It    musl    be  remembered   that    the  college  studi 
beside  having  had  the  bench)  of  the  four  years  high  school  and  the  one  year 

(35) 
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or  more  of  college  training,  arc  also  the  selected  pick,  presumably,  of  the 
eighth  grade  group.  Nevertheless,  then'  are  eases  in  the  last  three  years  of 
college  who  go  below  the  eighth  grade  median,  in  eighth  grade  work. 

Perhaps  you  may  feel  thai  specific  words  of  English  vocabulary,  specific 
types  of  arithmetical  problem,  or  specific  facts  in  the  history  of  the  United 
States  are  not   supposed  to  be  remembered;  they  are  supposed  only  to  do 
(heir  pari  in  the  educative  process  and  then  to  disappear,  leaving  only  some 
vague  general  benefit  behind  them.     One  then  wonders  if  this  vague  benefit 
might    not    be   procured  with    material    worth  remembering.     But,    however 
thai   may  be,  there  is  at  least  little  room  for  argument  with  regard  to  the 
assertion  that  ability  to  write  correct  English  is  of  continued  practical  im- 
portance.    Work  in  English  is  also  the  one  type  of  work  which  is  carried  fairly 
consistently  from  grammar  sehool,  thru  high  school,  into  the  University. 
So  we  should  expect  a  gain,  from  eighth  grade  to  college,  in  the  fundamentals 
of   English   composition.     The    English   Department  here   has  been  much 
interested  in  this  matter,  and  has  very  kindly  given  me  the  opportunity  to 
do  extensive  work  in  the  freshman  English  classes.     The  general  discouraged 
attitude  of  the  English  instructors,  with  regard  to  preparation  in  the  funda- 
mentals of  good  usage,  was  distinctly  just  died.     In  fact,  there  appeared  to 
be  less  gain,  from  the  eighth  grade  to  college,  in  ability  to  use  English  cor- 
rectly  than  in  any  other  subject  investigated.     And  in  both  eighth  grade 
and   college    the    most    elementary   and    inexcusable   blunders    appeared    in 
English. 

It  seems  to  me  very  decidedly  that  the  responsibility  for  this  most  un- 
fortunate situation  rests  primarily  upon  the  grammar  school,  first,  and  then 
the  high  school.     It  is  the  feeling  of  college  teachers  in  English  (and  a  feeling 
with  which  I  very  heartily  agree)  that,  by  the  time  a  man  or  woman  reaches 
college,   drill  in  spelling,  grammar,  and  punctuation  should  have  resulted  in 
established  habits  of  correct  usage  in  these  respects.     To  this  opinion  may 
lie  added  another,  that  much  as  few  people  develop  their  handwriting  during 
their  college  course  (the  habits  concerned  being  already  firmly  established 
ami   hardly  conquerable  at  this  age)  so,  few  people  change  essentially  or 
permanently  their  grammatical  habits,  or  their  habits  of  punctuation  or 
spelling,  from  the  time  they  enter  college  or  earlier.    If  drill  is  to  be  effective, 
it  must   be  during  childhood,  and  in  the  public  schools.     English  teaching 
lias,  apparently,  lacked  definiteness  of  aim.     There  has  been  lacking  intensive 
and  sufficiently  specific  drill.     There  has  been  an  unfortunate  diversion  of 
attention  to  literary  values  largely  beyond  the  comprehension  of  the  average 
child.     As   a    result,    the    schools  are  constantly  turning  out  children  who 
progress  into  college,  or  out  into  the  wide,  wide  world,  with  an  astounding 
inability  to  express  themselves  accurately  or  correctly  in  written  work  and, 
often,  w  ilh  only  a  cheap  smattering  of  sentimentalism,  or  an  early  adolescent 
disgust  of  all  things  "literary",  as  the  only  lasting  end  product  of  the  "in- 
spirational part"  of  the  teaching. 

It  was  primarily  from  the  test  results  I  have  just  mentioned,  and  from 
the  results  as  thus  interpreted,  that  the  present  study  grew.  When  such  a 
situation  is  suspected,  the  first  need  is  for  a  definition  of  that  situation  by 
means  of  some  exact  measurement.  Such  measurement  would  also  seem 
the  natural  point  of  departure  in  any  effort  at  improvement.  My  work 
during  the  past  year  has  aimed  particularly,  then,  at  a  definition  and  analysis 


Educational  Measurements  37 

of  the  factors  involved  in  abilit\   in  English  com  position  and  their  measure- 
ment. 

Yon  will  doubtless  feel  thai  the  natural  method,  in  investigating  ability 
in  English  composition,  would  be  to  use  some  our  of  the  standard  scales  for 
measuring  meril  in  English  composition,  of  which  the  Billegas  and  Willing 
Scales  are  types.     However,  skill    in   use   oi    such    scales    is   only    attained 
by  some  considerable  practice.     And,  even  then,  their  use  is  very  time-con- 
suming.    Since  we  had  adopted  as  our  motto  that  we  would  "Reduce  the 
high  cost  of  testing"        emphasis  being  particularlj  on  time  costs        use  of 
such  scales  hardly  lit  ted  in  well  with  our  program.     But  there  were  other 
objections  besides  this.     There  is  certainly  much  question  as  to  the  accuracy 
of  the  measurements  yielded  by  such  methods.     Our  first  effort  was,  then, 
to  investigate  the  accuracy  of  the  measures  yielded  by  such  instruments  as 
the  Ilillegas  and  Willing  Composition  Scales,    in   measuring   the  quality  of 
English  composition.     It  is  well  known  that  different    judges  may    differ 
decidedly  in  the  values  assigned  to  compositions,  when  rating  by  means  of 
comparison  with  these  scales.     I  felt,  however,  that  there  were  elements  of 
unreliability  in  the  method  that  had  not  been  heretofore  adequately  taken 
account  of.     Especially  I  wished  to  know  whether  children  who  wrote  well 
on  one  topic  wrote  comparatively  as  well  on  another  topic,  whether  children 
who  wrote  narrative  compositions  well  also  wrote  good  descriptive  com- 
positions.    I  therefore  had  several  students  rate  various  sets  of  compositions 
from  the  same  children.     The  ratings  were  then  correlated.     The  ratings  on 
narrative  and  descriptive  compositions,   or  on  successive  narrative  com- 
positions written  by  a  given  child,  were  surprisingly  inconsistent.     Thus, 
ratings  on  one  narrative  composition  correlated  with  ratings  on  another 
narrative  composition  written  two  or  three  days  later,  in  a  fifth  grade  class, 
with  a  coefficient  of  only  .15.     You  feel,  perhaps,  that  the  ratings  must  have 
been  unsatisfactory.     But  both  ratings  were  made  by  the  same  student, 
using  the  Willing  Scale,  and  the  compositions  were  procured  according  to 
Willing's  directions.     And  the  student  was  conscientious  and  an  experienced 
user  of  the  scale.     A  number  of  similar  studies  were  made.     The  most  ex- 
tensive piece  of  work  was  carried  thru  with  a  total  of  102  cases,  a  homogeneous 
group  consisting  of  all  the  8A  children  at  Bedford,  Ind.;  —  Superintendent 
Montgomery  very  kindly  cooperated  in  the  study.     The  first  set  of  themes 
was  narrative,  the  second  descriptive.     These  two  sets  of  compositions  were 
rated  very  carefully  by  an  experienced  English  teacher,  who  bad  taught  in 
both  junior  high  school  and  high  school.     The  correlation  of  her  ratings  on 
the  narrative  and  descriptive  compositions  was  only  .32. 

Such  a  low  correlation  surely  suggests  that  use  of  such  scales  cannot  but 
yield  a  result  largely  inaccurate.  We  wished  to  check  the  results,  however, 
in  another  way.  Three  of  the  teachers,  who  Avere  well  acquainted  with  the 
written  work  of  the  children,  therefore  estimated  t  he  ability  of  these  children, 
in  written  English.  These  ratings  were  then  averaged;  this  average  was 
considered  the  best  possible  evidence  as  to  the  sustained  general  ability  of 
these  children  in  written  expression.  The  correlation  between  the  ratings 
on  the  narrative  composition  and  these  estimates  was  found  to  be  only  .29. 
The  correlation  between  the  descriptive  composition  and  the  average  of  the 
estimates  was  only  a  little  higher  —  .33.  It  surely  seems  not  unreasonable 
to  infer  that  ratings  gained  by  means  of  any  one  of  tho  standard  scales  for 
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measuring  merit  in  English  composition  must  be  considered  distinctly  un- 
satisfactory because  of  these  various  elements  of  unreliability. 

The  question  then  was  as  to  whether  a  more  efficient  means  of  measuring 
ability  in  written  composition  might  not  be  found.  The  scales  I  am  pre- 
senting to  you  today  are  the  final  result.  It  was  our  conclusion,  from  the 
results  thai  1  have  just  presented  to  you.  that  "ability  in  English  composi- 
tion" was,  verj  decidedly,  not  a  single  ability  but  a  complex  of  abilities.  So 
analysis  was  desirable.  And  it  was  to  be  expected  thai  a  total  measure 
miji'ht  best  be  obi  a  i  ned  by  a  combined  statement  of  the  results  of  the  analysis. 

We  fell  that  the  formal  elements  were  the  first  elements  to  be  investigated. 
We  wished,  I  hen,  measures  of  ability  in  spelling,  in  punctuation,  and  in 
grammar.  We  also  felt  that  a  much  neglected  element,  in  both  ability  in 
silent  reading  and  ability  in  written  expression,  was  vocabulary.  We  there- 
fore wished  a  lest  of  vocabulary.  The  final  result  of  our  efforts  appears  in 
the  blanks  which  are  now  being  passed  out  to  you.  The  directions  and  the 
first  five  lines  of  the  vocabulary  lest  run  as  follows: 

Name <  'lass  or  Grade Section 

DIRECTIONS:     Below  are  some  statements  such  as 

An  oak  is  a:      tree     fish      vegetable     animal. 

Here  the  word  which  correctly  defines  "oak"  is  "tree",  so  "free"  1ms  been 
underlined.  The  statement  now  reads,  "An  oak  is  a  tree",  which  is  true. 
In  each  of  the  statements  below  you  have  four  choices  for  the  correct  word 
in  just  this  way.  One.  and  only  one,  is  right.  This  correct  word  you  are 
to  underline,  just  as  "tree"  is  underlined  in  the  example.  If  you  cannot 
be  sure,  guess.      Work  as  rapidly  as  you  can. 

1.  A  cog  is  a  part  of  a  :  building     bridge     boat      machine. 

2.  A  hypocrite  is  one  who:   admires     favors     deceives     dominates. 
.'!.     Anything  genuine  is:  impossible     intellectual      original     copied. 

4.  A  person  who  is  vaccinated  is:  dangerous      poor      tired     immune. 

5.  The  duty  of  a  jury  is  to :   plead     decide     justify     abjure. 

The  grammar  test  is  organized  as  follows: 

\;i  me (Mass  or  Grade.  .  .  .  Section.  .  .  .  Age 

DIRECTIONS:     On  each  of  the  lines  below  are  four  sentences  such  as: 
It  isn't  true.     We  was  home.     How  are  you?     All  are  here. 
One  of  these  four  sentences     "We  was  home" — is  grammatically  incorrect; 
this  wrong  sentence  has  been  underlined. 

In  each  of  the  lines  below  there  are  four  such  sentences.  One,  and  only  one  is 
grammatically  incorrect.  You  are  to  find,  in  each  line,  this  wrong  sentence. 
and  draw  a  line  under  it.  Work  as  rapidly  as  you  can.  And  remember, 
underline  the  incorrect  sentence.  If  you  are  not  certain  which  sentence  is 
incorrect,  guess. 

1.  I  wrote  to  him  and  her.     He  spoke  to  her  and  me.     She  stands  better 

than  I.      Between  you  and  I,  it's  not  so. 

2.  To  whom  should  it  go,  you  or  me?     Who  did  they  say  was  hurl'.'     Who 

will  the  book  be  read  by?      I  know  whom  he  struck. 

3.  She  is  far  ahead  of  me.      He  likes  me  but  not  them.      I  am  older  than  him. 

You  work  as  well  as  she. 

4.  That  seems  to  be  he.     You  and  they  must  decide.      We  girls  are  all  going. 

Does  that  apply  to  we  older  bins? 

5.  Every  girl  took  her  seat.     Each  of  us  have  one.     NT  either  of  them  is  right. 

Has  any  one  lost  his  knife? 
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The  nature  of  the  punctuation  tesl  can,  again,  be  inferred  from  the  fol- 
low ing  sample  material: 

Name ( 5-rade  or  Class Section 

DIRECTIONS  READ  CAREFULLY:  The  sentences  below  lack  all 
punctuation  and  capitalization  except  the  capital  at  the  beginning  of  each 
sentence  and  the  period  at  the  end.  ^i  mi  are  to  supply  all  further  punctua- 
tion marks  and  capitals,  changing  periods  to  interrogation  mark-  or  ex- 
clamation points  where  necessary.  In  manj  of  the  sentences  nunc  than 
one  mark  or  capital  is  needed ;  be  careful  to  put  in  all  t  bat  should  be  then 
Where  you  cannot  b<  sure  of  the  punctuation,  guess.  Make  all  your  marks 
clear  and  plain:  any  doubtful  marks  will  be  counted  againsl  you. 

1.  We  have  apples  peaches  plums  and  grapes. 

'J.  lie  was  satisfied  she  believed  with  the  report. 

.'!.  lie  went  home  everj   Saturday  in  July. 

4.  The  mothers  .yowii  and  both  daughters  dresses  were  white. 

.">.  He  hasnt  replied  because  youve  keen  away. 

The  very  brief  and  compact  "Manual  of  Directions"  for  giving,  scoring, 

and  recording  the  results  of  the  test  appears  on  the  two  sides  of  a  single 
small  sheet,  si  by  ~<\  inches,  as  shown  below.  (These  direction  sheets  are 
printed  on  light  blue  paper  so  that,  even  in  the  pack,  they  cannot  easily  be 
confused  with  the  blanks  to  be  passed  out  to  the  children.) 

Indiana  University  Department  of  Psychology 

DIAGNOSTIC  TESTS  IN   ENGLISH  COMPOSITION 

(Vocabulary,  Grammar,  and  Punctuation) 
For  Use  From  Junior  High  School  Thru  College 

Directions   for    Giving 

Any  one  of  the  three  tests  may  be  used  by  itself;  for  an  adequate  diagnosis 
all  three  tests  are  needed,  however.  When  all  three  are  to  be  given  it  is 
suggested  that  the  vocabulary  test  be  given  first,  then  the  grammar  test, 
and  finally  the  punctuation. 

The  procedure  is  the  same  for  each  test.  First,  before  distributing  the 
blanks,  make  certain  that  all  are  supplied  with  pencils  (or  pens,  if  any  do  not 
have  pencils).  Then  give  each  pupil  a  blank  face  down;  see  to  it  that  no 
one  turns  over  his  blank  before  he  is  told  to  do  so.  As  soon  as  all  are  supplied 
with  blanks,  read  the  following  directions,  verbatim: 

Now,  turn  over  your  blanks.  Write  on  the  line  at  the  top  of  the 
page  your  name,  your  class  (or  grade),  and  your  seel  ion  iil  class  is 
SO  divided).  Then  read  the  direct  ions  at  the  top  of  the  page,  and  do 
what  they   tell  you  to  (Jo.      Work  rapidly. 

Do  not  permit  any  questions  aboul  the  test,     [mmediatelj  after  finishing 

the  above  directions  note  t  lie  time,  and  collect  the  pa  pel'-  at  once  at   f  he  end 

of  5  minutes  (Vocabulary),  15  minutes  (Grammar)  or  K)  minutes  (Punctua- 
tion). 

Directions   for   Scoring 

Bach  test  has  40  lines.  Each  "line"  correct  counts  one  point ;  t  be  high 
possible  score  on  each  tesl  is  thus  40  points.  It  is  suggested  that  in  scoring 
a  check  be  made  against  t  he  number  of  each  line  correel :  total  score  on  each 
blank  is  then  total  number  of  check  marks.  Scoring  can  be  mos1  easilj  done 
by  comparison  with  a  blank  on  which  tin  correct  answers  have  been  marked. 
conspicuously,  in  ri'd.      Special  directions  for  each   test  run  as  follows: 

(a)  Vocabulary.     Bach  line  in  which  the  correct  word,  and  i ther. 
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has  been  indicated,  counts  one  point;  any  mark  (line  under,  cross,  check) 
unmistakably  indicating  the  correct  word"  is  to  be  considered  satisfactory. 
In  each  line  there  are  four  choices  for  the  word  completing  the  meaning  of 
the  sentence.  The  correct,  word  is  first,  second,  third,  or  fourth  as  indicated 
l>v  the  following  numbers  (the  first  number  is  the  number  of  the  list): 

4-4,  5-2;  6-4,  7-3.  8-1,  9-2,  10-2 

11-2,  15-1;  16-3,  17-3,  18-2,  19-4,  20-2 

24-4,  25-1;  20-3,  27-1.  28-2,  29-4,  30-4 

34.1,  35-3;  36-4,  37-4,  38-2,  39-1,  40-3 

(b)  Grammar.  Each  list  contains  four  sentences;  the  sentence  to  be 
marked  is  first,  second,  third,  or  fourth  according  to  this  same  key — and 
the  same  rules  hold. 

(c)  Punctuation.  The  scoring1  for  the  punctuation  test  is  given  on  a 
separate  mimeographed  sheet. 


1-4, 

2-3, 

3-3, 

1 1-1, 

12-1, 

13-1, 

21-1, 

22-3. 

23-2, 

31-1. 

32-3, 

33-2, 

Knri'ATiONAL  Mkasi  i:i:m  i:\ts 


II 


RECORD  SHEET 


DIAGNOSTIC  TESTS   IN   ENGLISH 
COMPOSITION 


Grade School City 

Dale State Examiner. 


Record:  For  each  test,  arrange  the 
blanks  in  order  of  total  scon-,  i  Keep  the 
results  from  differenl  grades,  classes,  or 
sections  separate,  and  record  on  separate 
record  sheets.)  Then  tabulate  the  re- 
sults in  the  spaces  on  t  be  right  -if  2  pu- 
pils make  a  score  of  29  on  the  grammer 
tesl  write  "2"  in  the  "Grammar-total" 
column  on  the  "29"  line,  etc.  Then  add 
together  all  the  figures  in  the  total  column 
am!  write  the  sum  in  the  space  marked 
"No  cases".  Finally,  counl  upfront  the 
bottom  to  the  middle  (or  median')  case, 
and  write  the  number  of  the  line  in  which 
this  case  falls  in  the  space  marked 
median". 

To  analyze,  go  through  the  papers 
again,  making  a  mark  or  dot,  in  the 
column  headed  '•analysis*',  for  each  item 
correct.  Thus  if  the  first  paper  shows  the 
39th  line  of  the  grammar  test  correct 
make  a  small  mark  in  the  "Grammar- 
analysis"  column  and  in  the  "39"  space. 
Then  count  up  the  total  number  of 
marks  in  each  space.  The  spaces  in 
w  Inch  there  are  fewest  marks  indicate 
the  grammatical  errors  on  which  the 
class  is  weakest.  Drill  in  "correct 
English"  should  emphasize  these  errors. 

Analysis  of  the  punctuation  test  re- 
sults should  be  made  in  the  same  way. 
Analysis  of  the  vocabulary  test  is  not 
worth  while. 

The  lines  of  the  punctuation  and 
grammar  tests  have  been  arranged  in 
ten  groups  according  to  the  type  of 
problem.  The  grouping  used  in  the 
punctuation  test  is  given  on  t he  punctu- 
ation score  sheet.  The  grouping  for  the 
grammar  test  runs  as  follows:  Janes  1-4 
case  of  pronouns;  5-8  agreement  of  pro- 
nouns; 9.12  agreement  of  verbs,  13-16 
tense  and  mode;  17-20  confused  verbs; 
21-21  irregular  verbs;  25-28  word  order; 
29-32  redundancy;  33-36  adjectives  and 
adverbs;  37- 10  prepositions  and  conjunc- 
tions. If  desired,  total  passes  in  each 
group  may  next  be  found.  Results  on 
individual  lines  are,  however,  most, 
important . 

The  tabulation  sheet  is  intended  only 
For  summary  of  the  results.  It  is  urged 
t  hat  t  he  teacher  beep  t  he  original  blanks 
and  use  these  as  a  point  of  departure 
in  remedial  instruction.  At  least,  a 
record  of  total  scores  should  be  kept  in 
the  class  book. 


Voc. 
Tot. 

( i-rammar 
Tot.    Analysis 

I'uncl  uat  ion 
Tot.   Analysis 

Id 

39 
38 
37 
36 
35 

34 
33 

:;2 
31 
30 

29 
28 
27 
26 
25 
24 
23 
22 
21 

20 
19 
18 
17 
16 
15 
14 
13 
12 
11 

■ 

10 
9 

8 
7 
6 
."> 
4 

:; 
2 
I 

0 

No.                 No. 

No. 

Med 

Median 

Median 
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Your  attention  is  particularly  called  to  the  diagnostic  nature  of  the 
grammar  and  punctuation  tests.  The  diagnostic  grouping  of  the  lines  in 
the  grammar  test  is  given  on  the  record  sheet.  The  diagnostic  arrangement 
of  the  punctuation  tesl  is  a  little  more  complex.  Sentences  1,  11,  21,  and  31 
have  to  do  with  the  use  of  commas  in  setting  off  words.  Sentences  2,  12, 
22,  and  32  involve  the  use  of  commas  in  setting  off  phrases  or  clauses.  Sen- 
tences 3,  13,  23,  and  33  require  capitals;  and  so  on  -  the  fourth  group  has 
to  do  with  possessives;  the  fifth  group,  apostrophes  and  abbreviations;  the 
sixth  group,  semicolons;  the  seventh  group,  question  marks  and  exclamation 
points;  the  eighth  group,  colons;  the  ninth  group,  quotations;  and  tenth 
group,  special  use  of  quotation  marks.  The  vocabulary  test  is  made  up 
simply  of  words  selected  at  random  from  a  small  dictionary.  1  might  saw 
however,  that  we  have  underway  a  special  analytical  vocabulary  test  which 
aims  to  indicate  comparative  knowledge  along  different   lines. 

Well  -  so  much  for  the  tests  themselves.  I  think  you  will  grant  me  that 
they  have  an  obvious  relevancy  to  the  factors  involved  in  ability  in  written 
English  with  which  they  are  supposed  to  deal.  They  would  appear  also  of 
some  little  analytic  value  in  investigating  knowledge  of  the  elements  of 
good  usage  and,  perhaps,  in  assisting  instruction  along  these  lines.  As  a 
matter  of  fact,  we  have  investigated  their  usefulness  in  some  detail.  1  shall 
not  worry  you  with  the  details  of  this  validation,  however.  I  wish  only  to 
give  you,  in  closing  the  discussion  of  the  tests,  one  striking  bit  of  result  for 
comparison  with  the  data  1  have  already  mentioned  dealing  with  the  value 
of  the  standard  scales  for  measuring  the  merit  of  compositions. 

1  said  a  minute  ago,  that  we  came  to  the  conclusion  that  ''ability  in 
English  composition"  was  really  a  complex,  involving  a  number  of  factors. 
It  was  further  suggested  that  a  total  measure  of  this  complex  might  best  be 
obtained  by  analyzing  the  situation  and  then  combining  the  results  of  the 
analysis.      We  have  attempted  to  do  just  this  thing. 

We  look  these  analytical  tests  (in  a  preliminary  form)  and  gave  them  to 
the  same  sA  group  from  which  compositions  had  already  boon  obtained. 
We  then  combined  results  on  the  tests,  and  correlated  the  total  with  the 
pooled  teachers'  estimate  of  ability  in  English  composition  which  I  have 
already  mentioned.  You  may  remember  that  careful  ratings  of  sample 
narrative  and  descriptive  compositions  written  by  these  children  correlated 
.29  ami  .33  respectively,  with  these  estimates.  And  now  the  surprising 
contrast  -  -  our  diagnostic  tests  (m  this  preliminary  form)  correlated  with 
tlie  pooled  estimate  with  a  coefficient  of  .72! 

So  we  have  some  evidence  that  these  tests  not  only  yield  a  diagnosis  of 
difficulties  m  English  composition;  they  also  combine  to  give  a  highly  valuable 
indication  of  total  ability  m  written  English.  But  I  must  not  dwell  upon 
this  point  longer.  Instead.  I  wish  to  indicate  to  you.  in  closing,  certain 
practical  advantages  of  these  materials.  And  by  way  of  contrast  I  wish  to 
mention  certain  examinations  which  have  recently  appeared  which,  to  my 
mind,  are  decidedly  impractical. 

A  few  days  ago  I  was  looking  over  a  new  examination  for  measuring  gen- 
eral intelligence,  for  use  in  the  first  three  grades.  The  blanks  for  this  scale 
cost  $6  a  hundred  and  stencils  for  scoring  and  manual  of  directions  and 
transportation  are  extra  at  that.     But  the  money  cost  is  not  the  worst  of  it-  — 
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the  worst  of  it  is  the  extraordinary  demand  on  th<  teachers'  time  which  ; 
of  this  examination  entails.  The  directions  to  the  children  cover  11  pages 
in  the  "Manual  of  Directions  ';  the  general  directions  to  the  examiner  and 
the  directions  for  scoring  cover  12  pages  more.  In  order  to  give  this  ex- 
amination, these  II  pages  must  be  practically  memorized;  the  manual 
advises  thai  the  directions  should  nol  be  read,  bul  should  be  given  from  notes 
made  on  a  copy  of  the  blank  used  by  the  children,  after  "careful  study"  of 
the  printed  directions  to  the  children,  in  the  manual.  That  the  examiner 
must  indeed  have  a  mastery  of  the  verbal  directions  may  be  realized  when 
the  number  of  ether  things  this  unhappy  person  must  do  is  appreciated. 
Not  only  musl  lie  say  the  directions  to  the  pupils.  lie  must  illustrate 
certain  tests  on  the  hoard,  occasionally  using  red,  green,  and  blue  chalk. 
He  must  point  out  certain  places  in  the  test  blank  to  the  children,  watching 
to  ••make  sure  that  1  lie  pupils  on  his  extreme  right  and  left,  as  well  as  thi 
in  the  rear  row  s.  see  w  here  he  is  pointing".  He  must  show  the  pupils  "how 
to  lift  the  forearm  only,  leaving  the  elbow  on  the  desk  to  avoid  fatigue",  in 
raising  the  pencil  between  tests,  and  should  ''see  that  all  children  have  their 
pencils  up".  He  must  do  this,  in  fact.  40  times  (something  of  a  job,  with  a 
restless,  lirst  grade  class!  ;  lie  musl  also  watch  for  a  hand  raised  to  indicate 
a  broken  pencil,  and  supply  new  pencils  at  once.  He  musl  observe  closely 
the  progress  cf  the  class,  on  most  tests,  so  a^  to  stop  work  "when  from  half 
te.  three-quarters  of  the  class  have  finished",  tho  on  one  test  he  is  told  to  call 
time  when  half  have  finished,  while  in  another  test  the  children  are  to  "stop 
work  when  three-fourths  of  the  class  have  finished".  In  another  test  he  is  to 
proceed  to  the  harder  items  or  not  according  as  "the  class  as  a  whole  is  re- 
sponding well".  Yet  we  are  told  that  "The  series  can  all  be  given  by  the 
classroom  teaeher"! 

So  much  as  an  example  of  tests  difficult  of  administration.  Xow  a  word 
with  regard  to  tests  involving  difficulty  of  scoring.  There  are  examples 
a-plenty  which  one  might  choose.  Perhaps  the  most  troublesome  type  <i\' 
difficulty,  a'  present,  is  the  test  involving  elaborate  statistical  handling,  with 
a  recalculation  and  transmutation  of  scores,  or  with  methods  lacking  thoro 
systematization.  Thus,  in  a  recent  examination  there  are  15  tests.  In  1  of 
these,  the  children  are  to  answer  by  underlining  a  word;  in  2,  they  cross  out 
a  word;  in  10  they  write  a  number.  This  is  nol  as  systematic  as  it  might  be. 
But  the  real  difficulties  have  nol  ye1  been  reached.  After  one  has  counted 
the  number  or  words  correctly  crossed  out  or  underlined,  or  the  number  of 
figure-  cornet,  has  the  final  score  been  obtained?  By  no  means!  In  1  ti 
the  score  is  "the  number  of  exercises  right  minus  the  number  wrong  and  in 
case  the  difference  is  negative,  call  it  it".  In  another  it  is  "the  number  of 
spaces  correctly  filled  in,  divided  by  1";  if  a  pupil  has  all  150  spaces  correctly 
filled  in,  he  receives  the  highest  possiMe  score  which  is  "150  divided  by  1.  or 
.'!7'."  (apparently  \  and  |  scores!).  In  '■'>  other  tests,  the  correct  score  is,  for 
the  purpi  se  of  combining  in  the  final  rating,  to  be  divided  by  3  -  and  in  2 
other  tests,  n  is  to  Ik-  divided  by  '.?.  In  another  test  a  "rate"  score  is  ob- 
tained by  taking  "the  number  thai  the  pupil  has  marked  a-  indicating  the 
line  he  was  reading  when  time  was  called  and  dividing  this  number  by  1". 
The  number  of  exercises  done  correctly  makes  up  a  "comprehension"  score. 
However,  on  thi-  test,  the  end  is  not  yet.  The  scorer  is  told  to  "note  that 
in  the  case  of  examination  II.  1  is  to  be  added  to  th<   'comprehension' score 
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and  l.">  to  the  'rate'  score,  before  the  scores  arc  transmuted  into  quotients". 
And  is  this  all?  Th  s  is  only  the  beginning.  All  the  scores  must  now  be 
copied  from  the  15  inside  pages  8  of  which  are  upside  down  on  to  the 
front  of  the  booklet,  and  then  added,  to  give  a  "total  point  score". 

However,  this  is  not  the  final  form  of  statement  advised.  The  scorer 
now  adds  "43  to  the  point  score  and  divides  by  10;  the  quotient  is  the  menial 
age".  But  a  percentage  statement  is  desirable.  So  the  result  of  this  last 
operation  is  divided  by  the  child's  chronological  age  (with  t  he  help  of  a  table 
which  is  kindly  provided  for  this  purpose).  That  is.  this  is  done  if  the 
child  is  not  over  14:  if  he  is.  the  arrangement  is  thai  one  "add  43  to  t  he  pupil's 
point  score  and  divide  this  by  the  average  score  for  his  chronological  age, 
plus  43".     But  for  ayes  above  18,  the  point  score  is  the  same  as  for  18. 

(It  is  only  fair  to  say  that  tables  are  provided  for  facilitating  some  of 
these  calculations.  The  tables  cut  down  the  labor  somewhat,  but  hardly 
reduce  the  essential  complexity  of  t  lie  situation.) 

All  the  calculations  described  in  the  last  paragraph  are  for  but  one-half 
of  the  examination.  The  scorer  now  goes  thru  much  the  same  process  for 
the  other  half  and,  by  the  relation  of  the  two  halves,  obtains  some  idea  of  a 
child's  school  work  in  proportion  to  his  ability.  But  the  person  who  i.^ 
scoring  the  examination  presumably  the  teacher-  is  not  thru  with  it  all 
yet;  the  results  must  be  recorded  on  the  class  record  sheet  which  is  no  small 
task.  And  yet  the  deviser  cf  this  scale  speaks  of  his  method  of  handling 
data  as  unusually  simple! 

With  such  time- and  patience-consuming  examinations  1  should  like  to 
have  you  contrast  our  little  "battery"  for  attacking  the  problem  of  "ability 
in  English  composition".  1  would  have  you  note,  in  the  first  place,  that  the 
blanks  are  very  cheap.  The  blanks,  with  directions  and  all  other  materials, 
<-o>t  only  30  cents  per  hundred;  blanks  for  a  class  of  35  would  cost  you.  then. 
only  about  10  cents.  Money  costs  are  thus  low.  So  also  are  time  cost-. 
The  tests  are  very  easy,  indeed,  to  give  and  could  be  trusted  to  any  of  your 
teachers.  All  that  is  necessary  is  to  pass  out  the  blanks,  face  down,  and  t  hen, 
once  all  are  supplied,  to  tell  the  pupils  to  "Turn  over  the  blanks!  Read  the 
directions,  and  do  what  they  tell  you  to  do".  Nothing  more  is  required  of 
t  he  examiner,  except  that  he  collect  the  blanks  at  the  end  of  the  allot ed  time, 
which  is  an  even  number  of  minutes  and  thus  can  be  readily  kept.  Scoring 
is  (with  the  possible  exception  of  the  punctuation  test)  easy  and  objective, 
and  interpretation  of  results  not  difficult.  Total  score  on  all  the  tests  com- 
bined is  obtained  by  simply  summing  the  scores  on  the  separate  lests. 

The  tests  are.  thus,  both  useful  and  usable;  they  are  practicable  so  far  as 
both  money  and  time  costs  go.  J  wish  to  emphasize  this  point.  We  are 
making  a  special  effort  this  year  to  "cut  the  high  cost  of  testing".  We  feel 
very  decidedly  that  many  of  the  scales  at  present  on  the  market  are  so 
expensive  as  to  prevent  their  use  by  many  school  systems  -  so  expensive 
as  to  limit  seriously  the  further  testing  program  of  such  schools  as  may  be 
able  to  invest  iii  them.  We  also  feel  that  many  of  the  present  tests  and 
scales  make  demands  upon  the  teacher  using  them,  in  the  way  of  time  and 
effort  in  giving,  and  particularly  in  scoring,  which  are  almost  intolerable 
We  feel  that  tests  should  not  be  a  burden;  they  should,  rather,  make  easier 
the  school  work;  and  we  feel  that  the  tests  should  be  cheap  enough  so  that 
use  of  a  variety  of  test  materials  may  be  possible.     Thruout  the  past  4  years, 
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my  wife  and  myself  have  been  the  011I3  workers  with  tests  of  intelligence 
who  have  consistently  kept  clear  of  elaborate  booklel  examinations;  no 
examination  which  we  have  issued  consists  of  more  than  a  4-pago  folder. 
The  lesis  which  we  arc  presenting  you,  at  this  conference,  are  a  step  further 
as  regards  cheapness  and  ease  in  use.  The  cosl  of  the  blanks  has  been  re- 
duced to  the  poinl  where  they  should  be  readily  available  for  aim me.  The 
tests  arc  self-giving;  almost  no  preparation  ts  needed  in  order  to  administer 
them.  And  the  scoring  is  comparatively  easy.  Any  of  you  who  have  had 
experience  with  some  of  the  elaborate  examinations  recently  issued  will 
appreciate.  I  am  sure,  t  hese  feature-,. 


Reading  Scales  for  the  Second,  Third,  and 

Fourth  Grades 


Li  ell  v  W.  Pressey 

Two  years  ago,  a1  this  conference,  !  presented  to  you  the  first  group  scale 
for  measuring  general  intelligence,  devised  for  use  with  children  in  the  first 
three  grades.  Since  thai  time  sonic  two  hundred  thousand  of  these  scales 
have  been  used.  Last  year  I  presented  our  "'Scale  of  Attainment  No.  1" 
for  measuring  achievemenl  in  reading,  spelling,  and  arithmetic  in  the  second 
grade.  This  morning  I  wish  to  describe,  very  briefly,  an  attempt  to  develop 
group  tests  for  measuring,  and  analyzing  progress  in  reading,  in  the  first 
four  grades.  Our  reading  vocabulary  tesl  Por  the  first  grade  has  now  been 
in  use  for  almosl  a  year,  however.  And  data  regarding  this  scale  has  already 
appeared  -  in  the  Elementary  School  Journal  tor  December  of  last  year. 
So  I  shall  deal  primarily  with  our  new  tests  for  the  second,  third,  and  fourth 
gri  des.  And  1  wish  to  discuss  two  points  with  regard  to  these  tests.  I  wish, 
first,  to  make  clear  to  you  our  general  basis  for  formulating  the  tests  and 
analyzing  the  reading  problem  in  the  way  we  have  done,  and  our  evidence 
thai  the  tests  do  measure  reading  ability  in  these  grades.  1  shall  then  point 
out,  shortly  (in  the  second  place)  certain  practical  advantages  which  these 
tests  have  which  make  them  unusually  practical  and  usable. 

There  are  already  in  existence  a  few  group  reading  tests  that  may  be  used 
in  the  second,  third,  or  fourth  grade.  Prominent  among  these  are  the 
Courtis  Silenl  Reading  Test,  the  Monroe  Reading  Test,  the  Ilaggerly  Read- 
ing Test,  and  the  new  test  from  the  Russell  Sage  Foundation.  All  these 
tests  are  supposedly  useful  in  the  lower  grades,  bu1  only  the  Courtis  and  the 
Haggerty  go  as  low  as  the  second  grade.  The  form  of  all  these  tests,  with 
the  exception  of  the  Courtis,  is  distinctly  artificial,  however.  Thus, 
•  me  finds  such  reading  materia!  as  "'Find  the  tail  on  the  rabbit  and  make  it. 
longer."  Such  reading  material  is  of  an  unfamiliar  and  often  somewhat 
absurd  nature.  A  further  objection  to  the  most  of  these  tests  is  a  purely 
practical  one.  Thus  the  Haggerty  tesl  is  printed  in  booklel  form  and  ts 
difficult  for  the  children  to  take.  J  have  given  this  test  and  !  have  found 
thai  many  of  the  children  would  reach  the  bottom  of  a  page  and  never  start 
the  next  one  at  all,  while  others  would  turn  over  two  pages  at  once  and  find 
themselves  confronted  with  such  hard  reading  material  that  they  could 
make  nothing  <  f  it.  The  Ayres  test  appears  upon  a  single  sheet  19  by  12 
inches.  The  sheet  is  too  large  to  go  conveniently  on  a  desk,  and  if  (some- 
thin";'  you  are  not  supposed  to  do)  you  fold  the  thing  down  the  middle  the 
crease  comes  across  an  item  -  and  the  page  is  still  awkward  to  handle. 
Young  children  often  become  absolutely  bewildered  in  trying  to  gel  control 
of  a  sheet  of  this  size.  The  items  of  this  test  are  arranged  in  columns, 
but  there  is  little  to  prevent  a  child  from  attacking  the  problems 
b\  proceeding  across  the  top  row  instead  of  down  the  first  column.  Infact, 
if  is  perfectly   possible  to  work  vertically,  horizontally,   diagonally,  or  to 
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execute  a  chess  move  of  one  to  the  left  and  two  forward,       all  of  which  adds 
an  element  of  confusion.     After  consideration  of  these  reading  tests,  my 
1  Holland  and  I  decided  thai  we  would  attempl  to  devise  tests  in  silen I  reading 
which  should  be  truly  applicable  to  children  of  the  second,  third,  and  four 
grades,  and  tests  which  would  be  convenienl  as  well. 

I  may  say.  at  one-,  thai  tho  we  have  called  t  hese  tests  tests  of  silent  read- 
ing ability,  we  have  nut  considered  '"silent  reading  ability"  an  entity,  nor 
have  we  taken  up  the  topic  from  the  more  usual  viewpoint.  It  would  be 
more  accurate  it'  1  should  speak  of  these  tests  as  tests  which  endeavored  to 
investigate  certain  of  the  mosl  important  factors  conditioning  readiness  in 
assimilative  reading.  Presumably  many  factors  operate  to  condition  the 
readiness  with  which  the  average  adult  reads  a  piece  of  printed  matter. 
He  will  read  that  matter  with  understanding  and  rapidity  in  proportion 
he  is  familiar  with  the  general  topic  treated,  is  interested  in  I  hat  topic,  know  - 
tin  meaning  of  the  words  which  are  used  in  the  passage,  and  applies  himself 
with  attention  to  the  reading.  "Silent  reading  ability"  may  perhaps  best 
be  thought  of  as  a  composite  of  such  elements  when  one  is  discussing  the 
I  roblem  of  silent  reading  ability  as  i  hat  problem  appears  in  the  upper  grades. 
Thus  in  testing  the  ability  of  older  children  to  read  a  certain  type  of  reading 
matter,  tests  in  interest,  vocabulary,  application,  etc.,  would  be  needed. 
In  the  first  grade,  reading  tends  to  be  an  end  in  itself;  by  the  time  the  children 
reach  the  seventh  or  the  eighth  grade,  reading  has  become  a  '"tool"  with 
which  to  get  lessons  in  other  subjects.  The  change  from  reading  as  an  end 
in  itself  to  reading  as  a  "'tool"  surely  begins  in  the  second,  third,  and  fourth 
grades.  With  these  younger  children,  the  problem  is  to  be  analyzed  dif- 
ferently. The  two  elements  which  we  have  thought  to  be  particularly  worth 
investigating  were:  (a)  growth  in  reading  vocabulary;  and  (b)  the  develop- 
ment of  speed  in  silent  reading  which  means  primarily  (as  we  saw  it  I  the 
elimination  of  oral  reading  habits  -  the  child  reads  rapidly,  largely  in  pro- 
portion as  he  has  learned  to  give  up  the  whispering  of  the  words  to  himself. 
The  two  tests  which  I  have  to  present  to  you,  then,  are  a  test  in  reading 
vocabulary  and  a  test  in  the  speed  of  reading. 

The  exact  nature  of  the  tests  can  best  be  understood  by  an  examination 
of  sample  sentences  and  by  quotations  from  the  directions.  The  tests  which 
we  give  first  is  called  "A  Speed  Test  in  Silent  Reading".  Sample  lines 
appear  below  : 

1.     This  man  is  very  out  poor. 
.5.     She  pretty  lived  with  her  mother. 
10.     The  women  cowards  are  very  brave. 
If).      He  had  a  strange  dream  blue. 
20.     The  man  comes  over  the  hill  house. 
25.     The  war  began  two  time  years  ago. 
The  tesl  endeavors  to  gel  at   the  persistence  of  oral  reading  ha'. its  by 
investigating  the  speed  with  which  children  can  progress  down  a  page  of 
exeeedinglj   simple  sentences.     The  sentences  were  all  selected  from  second 

grade   readers  and  contain   easj    and   familiar  words.      The  items  of  the   test 

are  all  of  approximately  equal  difficulty.  They  were  selected  from  a  large 
number  of  items,  as  being  easily  read  by  most  children  cf  t  hese  grades.  The 
question,  then,  was  as  to  how  rapidly  these  sentences  could  be  read  by  the 
cfc  ldren,  with  understanding  of  (heir  meaning.     As  a  check  to  insure  that  the 
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sentence  was  to  sonic  extent,  at  least,  understood,  the  very  simple  device 
has  been  used  of  putting  in  each  sentence  an  extra  word,  which  the  children 
are  to  find  and  indicate  by  making  a  pencil  mark  around  it.  The  advantages 
of  this  device  are,  I  believe,  apparent.  The  children  can  hardly  find  the  extra 
word,  without  sensing  to  sonic  degree  the  meaning  of  the  sentence.  But 
they  indicate  that  they  understand  the  meaning  by  an  exceedingly  simple 
operation  by  simply  marking,  in  some  way,  this  extra  word.  No  writing 
is  required  no   activity  which' might  interfere   to   any   extent    with   the 

progress  of  the  reading  itself.  The  whole  method  is  exceedingly  simple  and 
grasped  by  the  children  very  readily  indeed;  in  a  total  of  181  second  grade 
children.  no1  a  single  child  tailed  to  make  some  score;  only  one  child  scored 
below  1.  Such  a  fact  is  striking  evidence  that  the  test  is  readily  understood 
by  even  tin  young  children  —  that  the  activity  called  for  in  the  tests  is  by 
no  means  so  difficult  as,  in  itself,  to  present  a  special  problem. 

The  directions,  as  you  will  see,  are  printed  en  this  separate  sheet,  which 
is  tinted  bine  so  that  the  directions  can  be  at  once  distinguished  from  the 
children's  blanks.  The  question  and  answer  method  of  giving  the  directions 
is  used.  The  reason  for  this  method  is  very  simple.  Anything  formal  or 
artificial  simply  doesn't  go  with  young  children.  They  will  not  pay  attention 
unless  they,  themselves,  may  take  a  part  in  what  is  going  on.  That  you 
may  understand  the  nature  cf  the  directions,  T  will  read  the  directions  for 
the  speed  test  to  you.  The  blank  is  first  given  out  with  the  test  itself  face 
down;  the  back  of  the  test  blank,  as  you  will  see,  contains  spaces  for  the  name, 
age  and  grade,  and  examples.  The  children  are  told  (after  the  blanks  have 
been  distributed):  "Write  your  name  on  the  line  marked  'Name'.  Then 
write  your  age  in  years  right  below  in  the  space  marked  'Age'.  And  after 
that  put  your  grade."     They  are  then  told  to: 

"Look  at  the  first  sentence,  just  below  where  you  wrote  your  name. 
The  words  are,  'I  ball  see  a  boy.'  Do  you  all  see  the  sentence?  Now,  there 
is  an  extra  word  in  that  sentence,  —  a  word  that  doesn't  belong  there.  What 
is  the  extra  word?  Who  can  find  it?  Yes,  'ball'.  Everyone  draw  a  line 
around  'ball',  because  it  doesn't  belong  in  the  sentence.  The  sentence 
should  be  T  see  a  boy';  so  draw  a  line  around  'ball'. 

"Look  at  the  next  sentence.  What  is  the  extra  word?  Yes,  'cat'. 
Draw  a  line  around  'cat'  because  it  doesn't  belong  there.  The  sentence 
should  be,  T  can  see  my  book.' 

"Look  at  the  next  sentence.  What  is  the  extra  word?  Yes, 'ice'.  Draw 
a  line  around  'ice'  to  show  it  doesn't  belong  there. 

"Look  at  the  last  sentence.  What  is  the  extra  word?  Yes, 'tail'.  Draw 
a  line  around  'tail'  because  it  doesn't  belong  in  the  sentence. 

"And  now,  everyone  attention!  On  the  other  side  are  some  more  sen- 
tences. Do  not  turn  your  papers  over  yet,  wait  till  I  tell  you  to!  (See 
that  no  one  turns  paper  over.)  In  each  sentence,  on  the  other  side,  there  is 
just  one  extra  word.  You  are  to  find  the  extra  word  and  draw  a  line  around 
it.  Be  sure  to  work  just  as  fast  as  you  can  and  get  the  sentences  right. 
Now,  turn  over  your  papers  and  start!" 

The  children  are  given  just  4  minutes  to  work.  They  are  then  told: 
''Turn  over  your  papers  again,  at  once!  The  side  with  your  name  on  it 
should  be  up."  The  papers  are  then  collected.  The  whole  procedure  takes 
less  than  8  minutes. 
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Tbi'  \  ocabulary  teal  is  quite  as  simple  As  you  v\  ill  see,  it  consists  simply 
of  :i  small  sheel  mi  w  hieh  are  printed  such  questions  as: 

6.  What  do  you  do  with  a  knife?     write    sew    read     cut. 

'.».  What  is  a  coach?     a  stove     a  chimney     a  carriage     a  door. 

11.  I  low  does  a  coward  feel?    afraid     happy     sad    well. 

17.  What  is  a  pasture'.'     a  forest      a  river     a  held     a  lake. 

27.  What  is  a  companion'.'      a  friend      an  enemy      a  beasl      a  ship. 

36.  What  is  a  tempest?     a  sea     a  storm     a  light     a  hero. 

The  blanks  are  again  passed  out,  face  down,  the  children  being  warned 
not  to  turn  over  their  blanks  until  they  are  told  to  do  so.  As  soon  as  all  the 
blanks  are  passed  out,  the  command  is:  "Write  your  name  anywhere  on  the 
blank  side.  Under  your  name  put  your  grade."  After  the  children  have 
all  finished  writing  this  information,  they  are  told  to  turn  over  the  blank 
and  it  is  explained  to  them  (using  the  same  question  and  answer  method  and 
employing  the  first  4  lines  as  examples)  that  they  are  to  find  the  answer  to 
each  question  and  draw  a  line  around  this  answer.  Any  mark  indicating  the 
correel  word,  and  no  other,  is  accepted  as  satisfactory.  It  should  be  noticed 
again  that  the  response  of  the  children  is  very  simple;  a  single  mark  suffices 
for  an  answer,  so  difficulty  in  writing  does  not  operate  to  affect  the  score. 
That  the  children,  as  a  matter  of  fact,  do  understand  the  directions  readily 
is  evidenced  by  the  fact  that,  out  of  181  second  grade  children  recently  tested, 
only  1  child  made  a  score  below  9. 

The  test  is  not  a  time-limit  test.  The  intention  is  to  give  all  the  time 
that  is  necessary.  It  has  been  found,  however,  that  most  children  either 
finish,  or  have  progressed  as  far  as  they  can  go,  by  the  end  of  8  minutes. 
The  papers  are,  therefore,  collected  at  the  end  of  this  time.  The  words  used 
in  the  test  were  all  taken  from  school  readers  for  the  second,  third,  and 
fourth  grades,  and  are  words  which  occur  frequently  in  the  variety  cf  readers 
which  were  examined.     The  lines  are  arranged  in  order  of  difficulty. 

1 1  must  not  he  supposed  that  these  tests  were  t  he  only  tests  experimented 
with,  in  this  attempt  at  an  analysis  of  the  reading  problem  in  the  first  four 
grades.  Two  other  vocabulary  tests  wen;  also  tried,  and  one  other  speed 
test.  A  series  of  paragraphs  with  questions  following,  quite  similar  to  the 
(  'oiirtis  Silent  Reading  Tests,  were  also  extensively  worked  with.  One  form 
of  this  tesl  ha-  been  included  in  the  Third  Grade  Attainment  Scale.  All 
these  tests  were  tried,  and  were  then  rated  for  their  effieiencj  in  selecting  the 
good  and  poor  readers,  by  having  the  teachers,  in  the  room-  in  which  the 
experimenting  was  done,  turn  in  the  name-  of  the  5  lust  and  the  .">  poorest 
readers  in  the  room.  The  scores  made  by  the  poorest  readers  were  then 
marked  in  in  blue  on  the  tabulation  -heeis  (each  room  being  tabulated 
separately'  and  the  scores  of  the  five  l"sl  readers  in  the  room  in  red.  The 
two  tests  were  then  selected  which  marked  off  most  distinctly  the  two  ex- 
tremes as  thus  indicated.  Consideration  was  also  given  to  the  extent  to 
which  t  he  tests  supplemented  each  other,  contributing  distinctive^  to  a  total 
measure,  and  aiding  in  an  analysis. 

The  tests,  as  thus  made  up.  were  next  tried  in  a  survey  of  an  entire  school 
stem.     Superintendent  Montgomery  of  Bedford,  Ind..  very  kindly  allowed 

me  to  survey   his  second,  third,  and  fourth  grades  with  these  two  tests.      At 
the   time  of  testing,   each    teacher  of  a   third   grade  class  was  given   a    Maul-. 
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upon  which  she  was  to  make  ratings  of  the  "reading  ability"  of  her  pupils. 
This  reading  ability  was  further  denned  as  the  "ability  to  comprehend, 
quickly  and  easily,  the  material  encountered  in  the  regular  school  work". 
These  estimates  were  made  on  a  form  modeled  after  (lie  army  officers'  rating 
scale.  The  estimates  were  collected  on  the  same  day  that  the  tests  were 
given.  The  teachers  were  also  asked  to  check  the  nanus  of  those  children 
who  showed  the  persistence  of  oral  reading  habits  by  such  evidences  as 
whispering,  moving  the  lips,  following  the  text  with  the  finger,  and  so  forth. 
After  the  tests  had  been  scored,  they  were  correlated  with  the  teachers' 
estimates.  There  were,  in  all.  L93  pupils  in  the  third  grade,  all  of  whom 
were  included  m  the  con-elation.  The  correlation  of  fating  with  the  vocabu- 
lary l<  si  was  .59;  the  correlation  of  rating  with  the  speed  test  was  .01 ;  and 
the  intercorrelation  between  the  tests  was  .57.  A  further  correlation  was 
made  between  the  ratings  of  the  teachers  and  the  total  on  the  two  tests. 
This  coefficient  was  .05. 

Such  data  at  once  call  for  further  analysis.  Since  the  ccmbination  of 
the  two  tests  raises  the  correlation  with  the  ratings,  it  appears  that  the  two 
tests  supplement  each  other;  as  was  desired,  the  two  tests  seem  to  measure 
somewhat  different  factors  in  contributing  to  a  total  indication  of  ability  in 
assimilative  reading.  To  analyze  such  a  correlation  situation,  the  method 
of  partial  correlations  is  required.  The  partial  correlat  ion  between  estimated 
ability  and  vocabulary,  "speed  being  constant",  was  found  to  be  .38.  This 
means  that  the  distinctive  contribution  of  the  vocabulary  test  the  con- 
tribution not  made  by  the  speed  tesl  has  a  relationship  to  estimated  ability 
of  about  this  amount .  The  correlat  ion  of  the  ratings  with  speed,  "vocabulary 
being  constant",  was  found  to  be  .41.  Each  lest  may  then  be  considered  to 
yield  information  not  given  by  the  other,  the  combination  of  the  two  tests 
informing   us,    with    no   slight    degree   of   accuracy,    regarding   the   reading 

abilH  ies  Of   1  he  children    tested. 

As  a  final  check  on  the  validity  of  the  tests,  the  scores  of  those  children 
indicated  by  the  teachers  as  having  oral  reading  habits  wore  marked  in  on 
the  grade  distributions  of  the  Speed  Test.  All  these  children  scored  in  the 
lowest  10  percentile  group. 

In  interpreting  the  results  from  these  two  tests,  the  teacher  is  guided  bj 
the  following  suggestions,  on  the  directions  sheet,  which  are  based  on  these 
n  suits: 

Interpretation  of  Results.  A  high  score  in  Vocabulary  and  a  low- 
score  in  Speed  would  indicate  that  the  child  (or  class)  is  still  the  victim  of 
oral  reading  habits  which  retard  speed.  A  low  score  in  Vocabulary  and  a 
high  score  in  Speed  would  indicate  the  need  for  more  advanced  reading 
material.  Low  scores  on  both  tests  would  suggest  both  poor  reading  habits 
and  small  vocabulary.  High  scores  on  both  tests  would  suggest  the  possi- 
bility of  special  advancement.  In  any  case  the  teacher  should  use  the  test 
scores  as  a  point  of  departure  for  intensive  study  of  her  pupils. 

The  last  point  should  be  especially  emphasized  that  the  test  results 
are  only  starting-points  for  further  study.  Any  child  making  an  a-typical 
score  on  these  tests  should  be  made  the  object  of  intensive  study  along  such 
lines  as  those  suggested  above. 

So  much,  then,  for  the  first  pari  of  my  paper.  I  have  attempted  to  make 
clear  to  you  our  point  of  view  in  formulating  the  tests,  our  general  reasons 
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for  analyzing  the  reading  problem  in  the  way  we  have  done,  and  our  eA  idence 
thai  the  tests  do  measure  reading  abilitj  in  the  grades  deall  with.  Now,  1 
wish  to  say  a  few  words  with  regard  to  the  second  poinl  mentioned  at  the 
beginning  of  the  pap<  r,  with  regard  to  certain  practical  advantages  which 
these  tests  have,  making  them  unusually  practical  and  usable. 

A.s  has  already  been  indicated  to  you,  in  my  husband's  paper,  and  enforced 
by  our  various  charts  in  varied  colors,  the  sl<  gan  we  have  adopted  for  this 
year's  work  has  been  "Reduce  the  high  cosl  of  testing!"  and  we  have  had 
in  mind  no1  only  money  costs,  but,  particularly,  time  costs.  I  wish  to 
emphasize  to  you  the  way  in  which  thesi  ar<  an  evidence  thai  we  have 

worked  true  to  t  his  motto  of  ours. 

First,  regarding  money  costs.  We  are  selling  these  blanks  at  30  cents 
a  hundred,  which  means  that  blanks  for  a  class  of  35  will  cost  you  about  10 
cents.  I  should  like  to  contrast  this  with  an  examination.  "Sigma  1"  for 
grades  one  to  three,  issued  by  the  World  Book  Company,  arranged  ■ 
standardized  by  Baggerty  and  MissNoonan,  and  used  in  the  Virginia  Survey. 
These  blanks  cost  $5.60  per  hundred.  In  our  price,  of  30  cents  per  hundn  d. 
i-  included  our  little  combined  sheet  of  directions  for  giving  and  scoring 
with  table  for  tabulation  of  results.  If  you  use  this  more  expensive  exam- 
ination it  is  necessar\  for  you  to  pay  extra  for  a  score  sheet.  Moreover,  in 
order  to  get  the  directions  for  giving  you  must  buy  a  small  volume,  of  64 
pages,  including  directions  for  two  other  scales  and  costing  you  35  cents. 
Further,  transportation  on  this  bulky  material  is  by  no  means  a  negligible 
amount.  When  you  contrast  our  30  cents-  with  Haggerty's  total  of  between 
$6  and  $7,  1  think  you  will  grant  me  that  we  are  uo1   trying  to  proflte*  r. 

1  said,  however,  that  we  are  particulary  interested  in  time  costs.  And 
in  this  connection  I  should  like  to  have  you  consider  certain  items  in  the 
Haggerty  Scale.  For  instance,  item  number  2  is  a  picture  of  a  fish  and  a 
bird;  and  the  reading  matter  consists  of  this  command:  "Make  an  eye  on 
the  bird!"  These  of  you  who  are  familiar  with  firsl  and  second  grade 
drawings  will  grant  me,  I  beUeve,  that  it  ;-  not  always  easy  to  tell  whether 
a  first  grade  child  has  "obviously  intended"  a  mark  to  be  an  eye  cr  not.  In 
another  item  a  pig  is  shown,  and  the  child  is  told  to  "Put  a  tail  on  this  pig"! 
We  are  kindly  told,  m  the  scoring  directions,  thai  "any  kind  of  tail  put  on 
in  the  right  place  scores  right."  However,  the  situation  is  not  always 
clear.  For  instance,  tin-  child  is  shown  a  picture  of  the  limb  of  a  tree  with 
2  birds  sitting  on  it,  1  bird  Hying,  and  4  birds  sitting  on  the  ground:  the 
birds  are  very  small,  only  aboul  a  quarter  of  an  inch  across.  The  children 
are  told  to  "1'ut  a  cross  over  each  bird  that  is  on  the  ground."     And  in  the 

soring  directions  we  are  told  that  "Kach  cross  must  be  aboi(  a  bird,  nol 
a  bird,  to  score  right.  Score  right  if  there  is  a  cross  above  at  leasi  >  of  the 
bird-  that  are  on  the  ground."  But  in  the  Aery  next  item  we  have  two  child- 
ren hiding  in  a  box,  and  another  little  girl  who  has  found  them.  And  the 
reading  matter  below  tells  the  pupils  to  "Put  a  cross  on  each  child  that  is 
hiding.  Put  two  lines  under  the  girl  who  has  found  the  children."  And 
i  he  scoring  directions  are  "The  cross  must  be  />,,  each  child  in  the  box  to 
score  right .  Score  right  if  the  crosses  are  on  1  he  hair,  face,  or  clothes  of  I  1m 
children.  Score  wrong  if  cross  is  also  on  the  girl  outside  of  the  box.  Line- 
must  be  under  girl  outside  of  the  box  only  to  score  right."  It  may  surely 
be  questioned  whether  ability  to  read  with   understanding,   and   ability    to 
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follow  such  exacting  and  irrational  directions  arc  the  same  thing.  But 
altogether  aside  from  I  his  is  the  difficulty  of  scoring  such  a  test,  once  it  has 
been  given,  -lust  think,  if  you  will,  of  the  nice  problem  of  deciding-  whether 
each  cross,  laboriously  made  by  the  stubby  pencil  of  a  chubby-fingered 
first  or  second  grade  infant,  is  satisfactorily  placed  with  respect  to  a  quarter- 
of-an-inch  bird!  I  have  scored  (his  test  myself,  and  1  assure  you  that  it  is 
"some  job".  And  I  should  like  to  have  you  contrast  the  scoring  problem  of 
this  examination  with  the  simple  requirement  of  the  tests  I  just  presented 
to  you,  the  one  ride  being  that  '"The  correct  word,  and  no  other,  in  each 
line  must  be  marked."  These  little  tests  of  ours  can  easily  be  scored  at  the 
rate  of  three  a  minute.  I  doubt  if  anyone  could  get  thru  a  Haggerty  exam- 
ination in  less  than  -1  minutes,  -  -  not  to  speak  of  getting  thru  it  with  any 
peace  of  mind. 

Our  little  tests  are,  then,  cheap  in  money,  and  cheap  in  the  tune  and 
effort-  required  to  use  them.  We  I  rust  you  will  be  interested  in  experiment  ing 
with  these  materials. 


Standardized  Measurements  As  a  Means  of 
Determining  Most  Effective  Class  Size 


Hubert  G.  Child 

l\  this  period  of  increasing  tax  burdens  for  school  support,  a  maximum 
of  educational  efficiency  with  a  minimum  cost  is  greatly  to  be  desired.  Class 
size  is  one  of  the  most  important  factors  in  the  production  of  instructional 
costs.  Class  size  in  our  elementary  schools  lias  been  greatly  reduced  from 
the  numbers  of  former  years,  but  what  evidence  have  we  that  our  presenl 
standards  are  justifiable?  What  has  determined  our  present  size  of  class: 
the  burden  the  teacher  can  stand  or  a  high  type  of  achievement-  on  the 
part  of  the  class'.' 

During  the  past  twenty  years  a  number  of  investigations  have  Ween 
made  to  determine  the  relation  of  class  size  to  efficiency  of  class  result*. 
All  but  three  of  these  have  concerned  themselves  with  classes  in  the  ele- 
mentary schools. 

Methods  of  Determining  Efficiency 

Various  methods  of  determining  efficiency  of  results  have  been  employed , 
namely: 

(1)  Promotion   rate  (the  per  cent  of  pupils  promoted  at  the  end  of  the 

term). 

(2)  Withdrawals  (the  per  cent  of  pupils  withdrawing  during  the  term). 

(3)  Teachers'  marks  (the  median  or  average  class   scores  as  reported  by 

teachers  at  the  end  of  the  term). 

(4)  The  achievement  of    first  year  college   students  entering  from   high 

schools  with  a  majority  of  large  or  small  classes  (based  on    average 
grades  received  in  college). 

(5)  Teachers'  estimates  of  ideal  class  size. 

(6)  Standard  tests  or  examinations  given  in  various  grades  of   school  work. 

(7)  Growth  during  a  given    period    as  determined   by  standard   tests  or 

examinations. 

Limitations  of  TIkm'  Methods 

The  method  of  promotion  rate  is  subject  to  the  limitations  of  variations 
in   teachers'    marks  and   of  administrative   demands   that    non-promotions 

musl    1>e  limited. 

The  method  of  withdrawals  takes  no  account  of  the  variety  of  causes  for 
withdrawals,  hut  assumes  by  implication  that  withdrawals  are  due  to  in- 
effective teaching.  This  method  also  ignores  the  impossibility  of  securing 
accurate  statements  of  the  causes  of  withdrawals  from  pupils  and  the  in- 
adequacy of  school  records  relative  to  withdrawals. 

The   method   of   teachers'   marks   invokes  all   the   inaccuracies  due   to 

varying  and  subjective  standards  of  individual  teachers  as  to  what   a  given 
score  or  grade  represents  in  the  way  of  pupil  achievement.     These  variations 
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arc  marked  for  the  same  teacher  in  a  given  subject  at  different  limes,  for 
different  teachers  m  t  lie  same  subject,  and  for  teachers  in  different  subjects. 

The  method  of  judging  efficiency  in  high  school  instruction  by  the  grades 
earned  in  college  involves  all  the  errors  of  teachers'  marks,  takes  into  accounl 
only  a  minor  part  of  all  high  school  pupils,  and  those  the  most  capable  who 
will  succeed  reasonably  well  regardless  of  the  organization  and  quality  of 
instruction:  overlooks  the  fact  that  large  schools,  where  large  classes  are  in 
highest  proportion,  generally  have  the  more  experienced  and  highly  selected 
teaching  staffs;  and  also  overlooks  the  fact  that  pupils  in  larger  schools 
have  learned  to  look  out  for  t  hemselves  in  an  impersonal  and  mass  atmosphere 
while  pupils  from  the  smaller  schools  are  under  closer  supervision  and  may 
fail  to  work  as  successfully  the  first  year  in  college  where  (lie  close  supervision 
does  nol  exist. 

The  method  of  teachers"  estimates  of  ideal  class  size  is  subject  to  the 
limitations  of  general  impressions,  the  influence  of  the  class  size  leaehers 
are  most  accustomed  to  (they  generally  estimate  the  ideal  class  size  a  little 
smaller  than  the  size  of  the  classes  they  are  teaching,  except,  in  the  case  of 
very  small  classes,  and  the  influence  of  the  inadequacies  of  their  teaching 
equipment. 

The  method  of  using  standard  tests  at  a  given  time  as  a  measure  of 
achievement  fails  to  take  into  account  the  probable  inadequacy  of  the  tests 
to  include  the  essential  features  of  the  subject  as  emphasized  by  the  different 
teachers  whose  classes  are  tested,  and  overlooks  the  influence  of  conditions 
of  previous  years,  particularly  differences  of  pupils  in  achievement  when 
first  entering  the  classes  of  the  teacher  whose  classes  are  later  tested.  This 
method  also  has  the  limitations  that  in  many  of  our  subjects  no  standard 
tests  have,  as  yet,  been  devised. 

The  method  of  measuring  growth  during  a  given  period  by  standard 
tests  or  examinations  before  and  after  the  training  period  is  an  improvement 
over  the  single  application  of  the  standard  test,  but  otherwise  is  subject  to 
all  the  limitations  noted  above  for  the  method  of  using  standard  tests. 
With  high  school  classes  beginning  a  new  subject,  as  algebra,  a,  single  measure 
at   the  end  of  a  given  period  represents  the  growth  during  the  period. 

Results  and  Conclusions  of  the  Investigations 

1.    By  the  method  of  promotion  rate. 

a.  Cornman,  1909.     Class  size  has  little  or  no  influence  on  promotion 

rate  (in  the  elementary  school). 

b.  Boyer,  1913.     There  is  no  apparent  relation  between  class  size  and 

promotion  rate  (in  the  elementary  school  i. 

c.  Baehman,  1913.     The  promotion  rate  is  nearly  the  same  in  classes 

under  35  and  over  ."»()  and  there  is  no  warrant   for  changes  in 
the  policy  of  assignment  of  class  sizes  (in  the  elementary  school). 

d.  Elliott,  1914.     There  is  no  relation  between  class  size  and  promo- 

tion rate  (in  the  elementary  school). 
r.     Harlan,  1915.     ('lass  size  is  not  an  important  factor  in  promotion 
rale,    altho    small   classes   make   a    slightly    better  showing    (in 
elementary  schools). 
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2.    By  the  nut  hod  of  withdrawals. 

a.    I  l.iilan,   1915.     The  larger  the  class  the  higher  the  pei ntage  of 

permanent  withdrawals  (in  elementary  schools 

/;.  Neet,  L920.  For  firsl  year  high  scln.nl  classes  in  Lnglish,  Latin. 
French,  algebra,  history,  and  sciences  the  per  cent  of  with- 
drawals is  greatest  (10.7  per  cent  i  in  the  smallest  classes  (those 
having  15  pupils  or  IVwcr  and  is  nearly  the  same  for  classes  of 
size  16  to  '-'0,  21  to  25,  and  2ti  or  more  (7.1  percent,  7.3  percent, 
and  7.7  per  cent  respect iveh  . 
:!.     By  the  method  of  teachers'  marks. 

a.  Neet,  1920  (20  Indiana  high  schools).  The  most  efficient  class  size 
\  aries  for  different  subjects  and  different  years  of  work.  ( )n  the 
whole,  the  middle  range  classes,  16  to  25,  show  slightly  better 
results.  In  the  first  year  high  school  subjects  of  English,  Latin. 
French,  algebra,  history,  and  sciences  classes  of  26  or  more 
achieved  higher  average  grades  than  classes  of  15  or  fewer,  and 
classes  of  over  20  higher  than  classes  of  under  20.  The  highest 
average  grades  in  English  1  and  History  1  were  made  by  the 
classes  of  15  or  fewer,  but  in  French  1  and  Sciences  1  the  highest 
averages  were  made  by  classes  of  26  or  more.  For  Latin  1  and 
Algebra  1  the  results  were  substantially  the  same  for  classes  of 
16  to  20,  21  to  25,  and  26  or  more,  the  lowest  average  score 
being  in  classes  of  15  or  fewer. 

Table  1.      First  Year  Results  in  English,  Latin,  French,  Algebra, 

History,  Sciences,  Based  on  Teachers'  Marks 

(All  subjects  combined) 


Class  Size 

No.  OF 

<  !l  V.SSES 

Avebag  i: 
Score 

A \ erage 

Per  Cent  of 

Failure 

Average 

Per  Cent 

Withdrawn 

i  ader  L6.  .  .  . 

55 
103 
133 

107 

82.0 
SI. 5 
82   <» 
83.7 

13.9 
14   7 
11.7 
13   5 

10.7 

L6  i"  20 

2]   i  <>  25  .  . 

7.1 
7  3 

( ) ver  25  

7   7 

Table  2. 


First  Yeah  Resi  lts  in  English.  Latin,  French,  Algebra, 
History,  Sciences,  Based  on  Teachers'  M  irks 
iverage  Scores 


Besl  results — 

Smallest  classes:    English  and  history. 
Medium  to  large  classes:    Latin  and  algebra. 

Largest  classes:  French  and  sciences. 
Poorest  results — 

Smallesi  classes:  Latin,  French,  algebra. 
Medium  small  classes:  English,  history,  sciences. 
Medium  Large  classes:  no  subjects. 
Largest  classes:  no  subject. 


Class   Si/  e 

K  \  i  i  i  i  B  i  i 
1  A 

L  eiiN 
1  A 

French 
1 A 

\ i GEBRA 

1    \ 

History 

l 

S.    1  IN.    IS 

1 

i  ader  L6    . 

87  . 3 
si    s 
85  o 
s:<   5 

77.0 
82  0 

SL»     8 

82   0 

7'.).  5 
83  o 
83  3 
88.0 

79.3 

85 .  ■". 
82   (> 
84.0 

S4.0 
si   o 
82  0 
82  0 

83.4 

L6  to  20 

M   to  25 

83    1 

si   3 

Over  25 

86.3 
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1.    By  1  lie  achievement  of  firsl  year  college  si  udents  entering  from  certain 
type  high  schools. 
a.    [>ittenger,    1915.     The   besl    results  were  achieved   in     college     by 
students  who  came  from  high  schools  having  class  enrollments 
of  from  21  tc  30,  and  the  poorest  results  by  those  coming  from 
high  schools  having  cla^s  enrollments  of  under  20.* 
5.     By  the  teachers'  estimates  of  the  idea,!  class  size. 

a.  Cook,  1920.  Classes  of  20  to  25  are  pronounced  as  ideal  in  the 
majority  of  high  school  subjects.  Variations  are  indicated  for 
different  subjects  and  for  different    phases  of  the  same  subject. 

/*.  Meet,  1920  'based  on  replies  of  all  teachers  in  MS  Indiana  high 
schools).  "The  consensus  of  opinion  of  high  school  teachers 
seems  to  be  that  in  every  subject  the  highest  efficiency  is  at- 
tained in  classes  of  15  to  20,  inclusive."  About  70  per  cent  of 
all  replies  are  in  this  range,  but  1  per  cent  are  in  range  10  to  15 
and  7  per  cent  each  in  ranges  20  to  25  and  25. 

'"Middle  sized  classes  are  favored  because  of  easier  dis- 
cipline, more  individual  attention,  greater  opportunity  to 
recite,  more  inspiration." 

The  ideal  class  size  indicated  above  averages  from   3   to  ■"> 
smaller  than  the  average  sized  classes  in  actual  practice  in  the 
schools  reporting. 
0.     By    the   method   of  using  standard    tests   to   measure  achievement  at  a 
given  time. 

n.  Rice,  L907.  In  arithmetic  and  language  there  appears  to  be  no 
relation  between  class  size  and  results  (in  the  elementary 
school ). 

h.  Elliott,  1914.  Xo  group  possesses  superiority  because  of  class  size 
(in  the  elementary  school). 

c.  Harlan.  1915.  There  is  no  advantage  for  the  small  class.  The 
median  results  (Courtis  tests)  fell  in  the  median  sized  group 
(in  the  elementary  school). 

'/.  Neet,  1920  (data  from  10  schools).  The  highest  average  score  in 
first  term  algebra,  as  determined  by  the  Rugg-Clark  tests,  was 
2.23  for  the  group  of  classes  of  size  ]0  to  20  and  lowest .  1 .87,  for 
classes  of  26  and  more.  The  average  scores  for  classes  of  under 
16  and  21  to  25  were  2.05  and  2.07  respectively.  Median 
scores  are  1.96,  2. OS,  2.005,  1.85  respectively.  So  far  as  this 
method  has  validity  and  so  far  as  concerns  first  term  algebra 
the  most  effective  results  are  secured  in  classes  of  the  range 
16  to  25,  the  results  being  materially  better  than  in  classes  of 
26  or  more. 

"The  average  number  of  rights  per  group  is  highest  in  group 
16  to  20,  next  highest  in  group  21  to  25,  and  lowest  in  group 
26  to  30."  The  per  cent  of  accuracy  is  about  the  same  for  all 
groups  up  to  25,  but  is  materially  less  for  the  26  to  30  group. 

Miss  Neet  states  the  following  conclusions  as  a  summary  of  the  findings 
in  the  use  of  the  algebra  tests  tc  measure  efficiency: 


*Tliis  is  more  a  comparison  of  results  achieved  by  students  coming   from  large 

and  small  schools  and  involves  many  important  factors  other  than  class  si/.c. 
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i  I)    "The  most  efficient  sized  class  in  firsl  term  algebra  falls  m  group  1(1  to  20. 
i'_'i    Tlic  least  efficient  sized  class  in  first  term  algebra  falls  to  group  26  to  30. 
(3)    The  most  efficienl  class  size  varies  somewhal  for  differenl  schools, 
i  1 1    The  most  efficienl  class  size  varies  for  differenl  teachers. 
(.">)    Teaching  experience  in  mathematics  and  training  in  mathematics  l».\  the 

teacher  are  more  important  factors  in  determining  the  efficiency  of  a 

class  1  han  1  he  size  of  the  class." 

Table  :i.      First  Term   Resi  lts  in    Algebra   \>  Measi  red  bi   mm    Ri  gg 
Clark  Tests  i  Pirsi  8  Ti  sts)     Miss  Neet's  I  s\  i  .-  pig  i  i  ion 

( 'lass  Scon  s 


Under  16 

L6  to  20 

_'l   to  25 

Over  25 

1 . 59 ... . 

1.33 

I    56 
1    64 

1  .77 
2.08 

2  89 

2  90 
2.90 

3  1 2 

'.I. 
1  .29 
I    r,i 
1    66 
1    85 
I  .  88 
1  .96 

1  99 

2  00 
2  00 
2.01 
2.12 
2.18 
2   20 
2 .  33 

2   42 
2.59 
2.62 

2 .  75 
2.87 
2 .  96 
3.28 

1    21 

i    90 

1    31 

_'  02  .... 

1    33 

2   70    

1    3  I 

I     pi 

1    59 

I    6  1 

1    72 

1    7  t 

i    8  i 

I    86 

1  .86 

1  .98 

2    17 

2.20 

2   29 

2.43 

2  .  6."> 

2 .  67 

»   S9 

2.233 

2.07 

1.877 

M    .ii;ni    1    96      .... 

2.08 

2   005 

1    85 

Class  scores  were  determined  from  the  formula 
Class  rights  class  accuracy 

+   

Median   rights         median  accuracy 
7.    By  the  method  of  measuring  growth  during  a  given  period  of  time. 

a.    Elliott,   1914.     There  is  no  correlation  between  class  size  and  at- 
tainment (in  the  elementary  school.) 
6.    Breed  and  McCarthy,  1916.     The  larger  the  class  the  better  the 

results  up  to  a  class  size  of  45  (in  spelling  in  grades  3  to  8). 
c.     NTeet,  1920.      (See  previous  heading.     The  results  may  properly  l>e 
considered  here  as  measuring  achievement  in  a  now  subject  at 
the  end  of  a  half  year  as  equivalent  to  determining  growth 
during  a  given  period. 
Taking  into  account   certain   serious  limitations   in   the  methods  of  in- 
vestigation, the  foregoing  statements  indicate  that  for  the  elementary  school 
no  appreciable  differences  m  achievement  or  promotion  rate  are  noticeable 
for  classes  of  varying  sizes  up  to  45  or  50.     These  numbers  prohabh  convey 
a  wrong  impression,  as  quite  generallj  in  elementary  schools  classes  of  more 
than  30  are  divided  into  two  sections  for  recitation  purposes,  one  section  being 
engaged  in  study  while  the  other  is  reciting.  IC    I 

Miss  Neet's  use  of  standard  algebra  tests  to  determine  grow  i  h  iii  achieve- 


58  Bulletin  of  the  Extension   Division 

incut,  in  classes  of  different  sizes  is  the  mosi  accurate  and  reliable  investiga- 
tion in  t  he  high  school  bearing  upon  the  influence  cf  class  size.  The  findings 
apply  to  the  formal  processes  of  algebra  only,  and  similar  methods  applied 
to  other  lines  of  instruction  might  yield  different  results.  Also  it  would  be 
desirable  to  have  measures  of  the  general  mental  ability  of  all  classes  tested 
as  mental  ability  is  an  important  factor  in  achievement. 

An  important  limitation  to  all  these  methods  as  applied  in  previous  in- 
vestigations has  been  the  failure  to  analyze  critically  the  total  situation  to 
determine  the  factors  that  condition  teaching  efficiency,  and  then  to  so  con- 
trol the  experimental  situation  thai  results  may  he  definitely  referred  to  the 
causal  factor. 

Briefly,  some  <A'  the  more  important  factors  conditioning  teaching  effi- 
ciency are: 

1.    The  native  ability  el'  the  members  of  the  class. 
•J.    The  teachers,  including: 

<;.    Personality. 

Ik    Teaching  skill  as  evidenced  by: 

(1)  Training,  particularly  in  the  subject  taught. 

(2)  Teaching  experience,  particularly  in  the  subject  taught. 
:;.    Nature  of  the  subject  or  of  different  phases  cf  the  subject. 

4.  Methods  used. 

.">.  ( lass  size. 

G.  Length  of  time  the  class  has  studied  the  subject. 

7.  Method  of  determining  the  efficiency  score. 

Further  progress  in  solving  this  problem  must  depend  on  a  more  careful 
analysis  of  the  total  situation,  on  a  more  careful  definition  and  control  of 
experimental  conditions  and  factors.  Both  pupils  and  teachers  must  be 
carefully  selected,  results  must  hi-  considered  separately  for  different  grades 
and  subjects  and  not  for  all  grades  and  subjects  lumped  together  promis- 
cuously. The  measure  of  achievement  must  be  such  that  it  measures  what 
it  purports  to  measure  and  can  he  applied  uniformly  for  all  classes  tested. 
Achievement  should  include  not  only  memoriter  knowledge  and  skills,  hut 
also  habits  of  thought,  emotional  responses,  and  menial  and  moral  attitudes 
for  whose  acquisition  intimate  contact  with  strong  personalities  has  been 
t  houghl   necessary. 

No  singh  method  of  attack  will  be  likely  to  lead  to  the  complete  solution 
of  the  problem,  but  contributory  evidence  from  all  methods  refined  and 
widely  applied  may  enable  us  to  reach  conclusions  which  shall  lead  to  im- 
provement in  our  present  mode  of  class  grouping  for  both  educational  and 
economic  ends. 


I  Hagnostic  Test  in  Modern  European  History 


Cll  SlHLES    <  i.    V  \\M 

Indiana  University  maintains,  in  connection  with  the  Bloomington 
high  school,  a  practice  scl 1  for  teachers,  h  is  onr  plan  in  the  history  de- 
partment to  have  the  practice  teachers  give  the  various  standardized  tests 
in  t  he  different  fields  of  history.  In  looking  over  I  he  field  in  modern  European 
history  we  found  no  test,  so  we  proceeded  to  make  one.  As  far  as  we  know 
there  is  no  standardized  tesl  in  modern  European  history. 

The  Diagnostic  Tes1  in  Modern  European  History  consists  of  five  parts: 
Tests  A.  B,  C,  D,  and  E.  Tes1  A  is  a  tesl  for  time  sense;  test  B  for  place 
sense;  tesl  C  for  evaluation  of  facts;  tesl  I)  for  t  houghl ;  tesl  B  for  information. 
Tests  A,  B,  and  ( '  each  consists  of  •">  parts.  In  part  1  of  tesl  A  the  names  of 
10  personages  noted  in  modern  European  history  are  given,  arranged  in  no 
tixed  order.  The  pupil  is  asked  to  place  a  check  mark  after  any  name  he 
has  not  had  in  his  history  work  and  then  to  indicate  the  time  order  in  which 
'  lie  personages  lived  by  placing  a  figure  one  1 1  i  before  t  he  name  of  the  person 
who  lived  first,  a  figure  two  (2)  before  the  name  of  the  person  who  lived  next, 
and  so  on  thru  the  entire  list.  Part  2  of  tesl  A  contains  the  name-  of  10  im- 
portant events  in  modern  European  history.  The  pupil  is  directed  to  do 
here  the  same  as  he  did  in  pari  one  of  test  A.  Pari  •'!  of  tesl  A  contains  the 
name-  of  divisions  or  periods  in  modern  European  history.  The  pupil  is 
given  the  same  directions  here  as  in  parts  1  and  2  of  test  A. 

Part  1  of  test  B  contains  the  names  of  10  personages  noted  in  modern 
European  history.  The  pupil  is  asked  to  place  a  check  mark  after  any  name 
he  has  net  had  in  his  history  work.  He  is  then  to  underscore  the  word 
which  names  the  nationality  of  each  man.  Part  2  of  tesl  B  contains  the 
names  of  10  noted  European  events.  'The  pupil  is  given  the  same  direction 
here  as  in  part  J  of  test  P>.  Part  .'!  of  tesl  B  contains  the  names  of  10  im- 
portant modern  European  battles.  The  same  directions  are  given  here  as 
in  parts  1  and  2  of  test  B. 

Part  1  of  test  C  contains  the  names  of  10  important  facts  taken  from 
modern  English  history.  The  pupil  is  asked  to  place  a  cross  mark  after 
an\  fad  lie  has  not  had  in  his  history  work.  He  is  then  to  place  a  check 
mark  before  the  name-  of  the  3  events  thai  have  been  of  the  greatest  im- 
portance in  the  political  developmenl  of  England.  Pari  2  of  tesl  C  contains 
the  name-  of  10  important  facts  taken  from  modern  French  history.  As  in 
part    1   of  test   C,  the  pupil  LS  to  place  a  cross  mark  after  any  fact    he  has  nol 

had  m  his  historj  work.  He  is  then  asked  to  place  a  check  mark  before  the 
names  of  the  3  events  winch  have  been  of  the  greatesl  importance  in  the 
religious  developmenl  of  France.     Tart  3  of  tesl  C  contains  the  names  of  LO 

important   facts  taken  from  i lern  German  history.     As  in  parts  1  and  2 

of  tesl  ' '.  the  pupil  is  to  place  a  i  ark  after  any  fact  he  has  nol  had  in 

his  historj   work.      He  is  t  hen  to  place  a  check  mark  before  the  names  of  : 


60  Bulletin  of  the  Extension   Division 

.'1  events  thai  have  been  of  the  greatesl  importance  in  the  industrial  and 
eci  nomic  development  of  Germany. 

Test  I)  contains  10  thought  questions  of  varying  degrees  of  difficulty. 
A  blank  space  is  left  following  cadi  question  in  which  the  answer  is  to  be 
written.     The  following  is  question  number  7  of  this  list: 

The  A n si  i-<i- Hungarian  Empire  was  composed  of  an  extraordinary  mixture 
of  peoples.  In  Austria-Hungary  were  found  Germans,  Czechs,  Poles,  Croa- 
tians,  Italians.  Slovenes,  Serbs,  Ruthenes,  Slovaks,  and  Roumanians.  In 
general  each  of  these  people  li\  ed  adjoining  1  heir  fatherland,  i.e.,  t  he  Italians 
in  Austria-Hungary  lived  in  territory  adjacent  to  Italy,  the  Roumanians  in 
territory  adjacent  to  Roumania,  etc.  These  people  were  not  satisfied  at 
all  witli  the  Austro-Hungarian  rule  and  were  anxious  to  he  annexed  to  their 
nati\  e  countries. 

A.  Why  was  the  Austro-Hungarian  government  deeply  concerned  with 
what  went  <;n  in  a  political  way  in  Germany,  Ilaly,  Roumania,  Serbia,  and 
in  all  the  countries  about  her'.' 

B.  When  Austria-Hungary  was  defeated  in  the  World  War  what  would 
you  expect  would  happen  to  her  different  territories'.' 

Seven  of  these  10  thought  questions  deal  with  very  recent  events,  most 
of  them  leading  up  to  or  growing  out  of  the  World  War. 

Test  E  contains  0  questions,  apparently  of  an  informational  character. 
Following  the  questions,  blank  spaces  are  left  for  the  answers.  (Question  1 
in  this  list  is  as  follows:  "What  are  the  'natural'  boundaries  of  France?" 
Question  <>  is  as  follows:  "What  European  nations  secured  possessions  in 
Africa  in  the  nineteenth  century?" 

Accompanying  the  test  is  the  following  questionnaire  to  be  tilled  in  by 
the  teacher  whose  pupils  have  taken  the  test: 

1.  Name  of  city 

2.  Population  of  city 

3.  Name  of  teacher  whose  pupils  have  taken  the  test 


4.  Teacher's  age 

5.  Sex , 

0.  Number  years  teaching  experience 

7.  Number  years  teaching  experience  in  history 

**&  X.  Number  years  teaching  experience  in  modern  European  history 


9.     Number  years  teaching  experience  in  present  sdiool  system. 


10.      Has  teacher  taken  a  course  in  the  methods  of  teaching  history'.' 

Where? When? 

1  1.      Has  teacher  taken  a  course  in  practice  or  supervised  teaching  in  history? 

Wliere? When? 

12.  Is  teacher  a  high  school  graduate? 

13.  Years  of  normal  or  college  work  done  by  teacher 

14.  College  or  university  degrees  held  by  teacher 

1  5.     Date  this  test  was  given 

The  test  is  primarily  a  diagnostic  test.  It  aims  to  find  out  as  much 
about  the  teacher  as  about  the  pupil.  The  teacher's  answers  to  the  questions 
in  the  questionnaire  may  explain  the  pupils'  answers  in  the  test  papers. 
If  an  entire  class,  or  a  considerable  portion  of  an  entire  class,  places  a  cross 
mark  after  the  name  of  Lloyd-George  in  part  1  of  test  A,  we  may  feel  quite 


EDI  CATION  \i.    M  BASl  kkmi:\  i  S  61 

sure  thai  the  class  has  qo1  spenl  much  nine  upon  reallj  recenl  modern 
European  bistory.  [f  a  class  states  that  it  hasnol  had  I  he  Industrial  Revolu- 
tion in  iis  history  work  bul  returns  a  high  mark  on  the  Lisl  of  the  l<)  European 
battles,  we  are  to  infer,  to  some  degree  at  Least,  thai  the  teacher  of  thai  class 
needs  to  change  ber  viewpoinl  of  teaching.  IT  the  class  cannol  answer  the 
questions  slated  above  -  questions  1  and  6  in  test  E  we  feel  quite  sure 
thai  the  teacher  has  overlooked  two  very  importanl  factors  closely  connected 
with  the  events  of  the  past  few  years. 

In  each  of  the  ■">  parts  of  tests  A.  P».  and  ('  the  pupil  is  asked  to  place  a 
cross  mark  after  any  name,  event,  or  fact   thai   he  has  uol   bad  in  bis  history 
work.     By  this  means  we  are  enabled  to  tell  jusl  what  pari  of  the  histo 
work  lias  receh  ed  no  emphasis. 

By  the  answers  returned  in  test  I ).  we  arc  enabled  to  tell  whether  or  uol 
the  teacher  has  been  placing  emphasis  upon  recent  history,  as  7  of  the  10 
questions  deal  with  very  recent  events. 

In  the  returns  from  each  school,  the  pupils'  answers  are  read  and  scored 
in  connection  with  the  reading  and  scoring  of  the  questions  in  the  question- 
naire answered  by  the  teacher  of  that  school. 

The  following:  is"  the  test.  It  is  based  wholly  upon  Kohinson  and  Beard's 
Outlines  of  European  lli.slori/.  Part  IT,  the  textbook  thai  is  used  in  the  high 
schools  in  Indiana.  The  tesl  has  not  been  standardized  and  is  in  a  tentative 
form  only.  It  is  now  being  given  in  aboul  50  high  schools,  large  and  small, 
in  all  parts  of  the  state  of  Indiana.  The  results  from  these  schools  will 
render  a  partial  standardization  possible. 

As  to  form,  there  is  little  that  is  new  in  the  test.  Old  forms  have  simply 
been  transferred  to  a  new  field.  In  this  matter  the  author  is  indebted  to 
M.  J.  Van  Wagenen.  of  the  University  of  Minnesota,  and  Arvil  S.  Barr,  of 
Evansville  College.  Valuable  suggestions  and  criticisms  have  been  received 
from  Professors  Hubert  G.  Childs  and  William  T.  Morgan,  of  Indiana  Uni- 
versity, and  from  Dean  William  S.  Gray  and  Professors  A.  C  McLaughlin, 
Holla  M.  Tryon,  and  Ferdinand  Schevill,  of  the  University  of  Chicago. 


Diagnostic  Test  in  Modern  European  History 


Charles  Garrett  Vannest,  Indiana  I'niversity 

BUREAU    OF  COOPERATIVE    RESEARCH,   Indiana  University 

Bloomington,  Indiana 

Name Race 

Sex Age 

School City 

Year  in  High  School Date 

Teacher 

TEST  A.     TIME  SENSE 

I.        The   following   list    contains   the   names   <>l'   ten    personages   noted    in 
Modern  European   History. 

1.  After  reading  the  list  through  carefully,  place  a  cross  mark  (x) 
after  any  name  you  have  not  bad  in  your  history  work. 

2.  Indicate  the  time  order  in  which  the  personages  lived  by  placing 
a  figure  one  (1)  before  the  name  of  the  person  who  lived  first,  a 
figure  two  (2)  before  the  name  of  the  person  who  lived  second,  a 
figure  three  (3)  before  the  name  of  the  person  who  lived  third 
and  so  on  through  the  entire  list. 


a. 

( 

I 

Frederick  the  Great. 

b. 

1 

) 

Metternich. 

c. 

1 

» 

Bismarck. 

d. 

1 

) 

Lloyd-George. 

e. 

l 

i 

Louis  XIV. 

I'- 

1 

) 

( !romwell. 

ll- 

( 

> 

Napoleon  Bonaparte 

h. 

( 

) 

<  'a\  our. 

i. 

( 

) 

Gladstone. 

./■ 

( 

) 

Elizabeth. 

II.      The   following   list   contains   the    names   of   ten    important   events   in 
Modern  European   History. 

1.  After  reading  the  list  through  carefully,  place  a  cross  mark  (x) 
after  any  event  you  bave  not  had  in  your  history  work. 

2.  Indicate  the  time  order  in  which  the  events  happened  by  placing 
a  figure  one  (1)  before  the  event  that  happened  first,  a  figure  two 
(2)  before  the  event  that  happened  second,  a  figure  three  (3) 
before  the  event  that  happened  third,  and  so  on  through  the 
(■tit  ire  list. 

The  Congress  of  Vienna. 

The  Russo-Japanese  War. 

The  Glorious  Revolution. 

The  French  Revolution. 

The  Lniticat  ion  of  Italj  . 

The  Treaty  of  Utrecht. 

The  Franco-Prussian  War. 

The  Boer  War. 

The  Industrial  Revolution. 

The  Expedition  of  the  Spanish   Armada.. 

(62) 


a. 

< 

1 

b. 

1 

' 

r. 

( 

1 

(1. 

< 

1 

i  . 

I 

1 

f. 

( 

) 

ti- 

( 

) 

ll. 

( 

1 

i . 

< 

1 

J- 

( 

) 

Educational  Measurements  <'.:', 

III.    The  following  lisl  contains  the  names  of  the  main  divisions  or  periods 
in  Modern  European  I  [istory. 

1.  After  reading  the  list  through  carefully,  place  a  cross  mark  i\» 
after  any  division  yon  have  not  had  in  your  history  work. 

'_>.  Indicate  the  time  order  in  which  the  periods  come  by  placing  a 
figure  one  (l)  before  the  division  which  conn-  first,  a  figure  two 
(L'i  before  the  division  which  come-  second,  a  figure  three  (3) 
before  the  division  which  comes  third,  and  so  on  through  the 
entire  list. 

n.    t     )    The  French   Revolution  and  Napoleon  Bonaparte. 
it.    (      i    I  'nilication  of  European  Stat< 

c     (     )    Absolutism  and  the  Rise  <<\'  the  Democratic  Spirit. 
<l.    t      )     Mercantilism  and  the  Struu'<d(    for  Colonial  Suprem- 
acy. 
e.     (     )    The  World  War. 
/.     (     )    Social   Democracy  and   Territorial   and   Commercial 

Rivalry. 
g.    (     )    Reaction,  Revolution,  and  the  Rise  of  the  Democratic 
A  fovement. 

TEST  B.—  PLACE  SENSE 

I.  Tin     following  list   contains   the   names   of    ten    personages   noted    in 
Modern  Furopean  History. 

1.  After  reading  the  list  through  carefully,  place  a  cross  mark  (x) 
after  any  name  you  have  not  had  in  your  history  work. 

2.  I'nderscore  the  word  which  names  the  nationality  of  each  man. 

a.  John  Hampden  was  an  English,  German,  French,  Italian 

squire. 

b.  Peter  the  Great  was  a  French,  Prussian,  Russian,  Italian 

ruler. 

c.  Luther  was  a  Russian,  English,  French,  German  reformer. 
'/.    William    Pitt    was    a    French,    Italian,    English,    Prussian 

statesman. 
e.    Voltaire  was  a  Prussian,  Russian,  French,  Italian,  Spanish 

writer: 
•  /.    Xewton  was  an  Italian,  Spanish,  Prussian,  English,  French 

scientist. 
g.    Turgot  was  an  English,  Prussian,  Russian,  Spanish,  French 

economist. 
h.    Stein  was  a  French,  Spanish,   Prussian.    Russian,   English 

statesman. 
i.    Talleyrand    was    an    English,    French,    Prussian,     Italian, 

Russian  statesman. 
,/.    Garibaldi  was  a  Russian,  Prussian    French,  Indian,  Spanish 

soldier. 

II.  The  following  list  contains  the  names  of  ten  noted  Modern  European 
c  ents. 

1.  After  reading  the  list  through  carefully,  place  a  cross  mark  <\i 
after  any  event  you  have  not  had  in  your  history  work. 

2.  I'nderscore  the  name  of  the  country  in  which  each  event  took 
place. 

a.  The   Petition  of   Rights  was  a   French,   Prussian.   English, 

I  talian,  Spanish  measure. 

b.  The    Estates   General   was   an    English,    Italian.    Spanish, 

French,  Russian  governing  body. 

c.  The   Declaration   of  the   Rights  of  .Man   was  a    Prussian, 

[talian,  Spanish,  French,  English  measure. 
il.    The  Reign  of  Terror  took  place  in  England,  Prance.  Prussia, 

Russia,  Italy,  Spain. 

e.    The  Puritan  Revolution  took  place  in  Spain,  Etaly,  Portugal, 
France,  England,  Prussia. 
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/.     S  pi  mi  ing  and  weaving  machines  were  Brs1  invented  in  Spain, 

France,  England,  Prussia,  Italy. 
g.    The  Zollverein  (customs  union)     was  formed  in   England, 

France,  Prussia.  Spain,  Italy. 
h.    The  Dreyfus  Affair  occurred  in  England,  France,  Germany. 

Spain,  Italy. 
i.     The   Reform   Bill  of  1832  was  a  French,  Spanish,  English, 

Italian .  Prussian  measure. 
j.    The   three-class   system   of   voting  was   used  in   England, 

Frances  Prussia,  Spain,  Italy. 

I J  I.    The  following  lisl  contains  the  names  of  ten  important  Modern  Europe- 
an battles. 

1.  Al'ief  reading  the  list-  through  carefully,  place  a  cross  mark  (x) 
after  the  name  of  any  battle  you  have  not  had  in  your  history 
work. 

2.  Underscore  the  name  of  the  country  in  which  the  battle  took 
place. 

a.  The  battle  of  Marengo  was  foughl  in  Italy,  France,  England, 

Prussia. 

b.  The   battle  of  Austerlitz  was  fought  in   Prussia,  Austria, 

Fiance,  England,  Italy. 

c.  The  battle  of  Liitzen  was  foughl  in  Austria,  Italy,  Spain, 

France,  Prussia,  England. 

d.  The   battle  of  Waterloo  was  fought  in  England,    France, 

Prussia,  Belgium,  Holland. 
'.    The   battle   of   Sadowa    was   fought  in   Prussia,    England, 

Austria.  Italy,  Russia. 
/.    The  battle  of  Sedan  was  foughl  in  France,  England,  Russia, 

Italy,  Austria,  Prussia. 
g.    The  battle  of  Sebastopol  was  fought  in  England,   Prussia, 

Russia,  Austria,  France. 
h.    The  battle  of  the  Marne  was  fought  in  Italy,  Spain.  Russia, 

France,  Belgium. 
i.    The  battle  of  the  Pyramids  was  fought  in  Spain,  France, 

Portugal,  Italy,  Egypt,  Asia  Minor. 
j.     The  battle  of  the  Somme  was  fought  in  Germany,  France, 

England,  Spain,  Portugal. 

TEST  (■).— EVALUATION  OF  FACTS 

I.  The  following  list  contains  the  names  of  ten  important  facts  taken  from 
Modern  English  History. 

1.  After  reading  the  list  through  carefully,  place  a  cross  mark  (x) 
after  any  fact  you  have  not  had  in  your  history  work. 

2.  Place  a  check  mark  (v)  before  the  names  of  the  three  events  that 
have  been  of  the  greatest  importance  in  the  political  development 
of  England. 

'/.  (  )  The  theory  of  the  "divine  right  of  kings". 

b.  <  )  The  Separatists  leave  England  and  go  to  Holland. 

c.  <  )  The  Conventicle  Act. 

d.  i  )  The  Act  of  Settlement. 

e.  I  )  The  Reform  Bill  of  1807. 

/'.  (  )  The  Settlement  of  Australia, 

g.  (  )  The  Boer  War. 

h.  (  )  King  James's  translation  of  the  Bible. 

i,  I  )  Pl'ide's  Purge. 

j.  (  )  The  Habeas  ( "orpus  Act. 

II.  The   following  lisl    contains   the   names  of  important  facts  taken  from 
Modern  French  1 1  istory. 

I.  After  reading  the  list  through  carefully,  place  a  cross  mark  (x) 
aftor  any  fact  that  you  have  not  had  in  your  history  work. 
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Place  a  check  mark  (v)  before  the  names  of  the  threo  events  that 
have  been  of  the  greatest  importance  in  the  religious  development 
of  France. 

Louis  XIV's  invasion  of  the  Netherlands. 

Revocation  of  the  Edici  of  Nantes. 

Reforms  of  Calonne. 

Tho  Franco-Prussian  War. 

The  fall  of  the  Bastille. 

The  Concordat  of  1801. 

The  Code  Napoleon. 

Execution  of  Louis  XVI. 

Separation  of  Church  and  State  in  1905. 

France  recovers  Alsace-Lorraine. 

III.     The  following  list  contains  tho  names  of  important  tacts  taken  from 
Modern  German  History. 

1.  After  reading  the  list  through  carefully,  place  :i  cross  mark  I  x) 
after  any  fact  you  have  not  had  in  your  history  work. 

2.  Placo  a  check  mark  (v)  before  the  names  of  the  three  events  that 
have  been  of  the  greatest  importance  in  the  industrial  and 
economic  development  of  Germany. 

The  Zollverein  (the  customs  union). 
Bismarck  Prussianizes  Germany. 
Formation  of  the  North  German  Federation. 
Bismarck  makes  terms  with  Catholic  party. 
Adoption  of  a  protective  tariff  system  (1879.) 
The  groAvth  of  machine  industry. 
Formation  of  the  Triple  Alliance. 
Resignation  of  Bismarck. 
)  .Germany  secures  Alsace-Lorraine  (1871). 

Germany  secures  African  Colonies  (1884-1890). 

TEST  D—  THOUGHT 

Below   you   will   find    ten   questions.     Answer   each    question   in    the 
space  below  it. 

1.  King  James  II  desired  to  re-establish  Catholicism  in  England. 
He  had  married,  as  Ms  second  wife,  a  Catholic.  A  son  was  born 
to  them.  James's  daughter,  Mary,  by  his  first  wife,  had  married 
a  Protestant,  William  III,  the  head  of  the  United  Netherlands. 
.lames  also  insisted  on  making  laws  without  the  consent  of 
Parliament.  The  English  nation  did  not  want  Catholicism  re- 
established and  did  not  want  the  king  to  rule  without  the  consent 
of  Parliament. 

a.  When  the  English  people  invited  William  and  Mary  from 
Holland  to  become  their  rulers,  what  did  Parliament  insist 
upon  before  making  them  king  and  queen  of  England? 

2.  By  the  Act  of  Settlement,  George  I  becamo  king  of  England,  1714. 
George  I  was  a  German  and  was  ruler  of  Eanover  in  Germany. 
When  he  becamo  king  of  England,  George  I  was  unable  to  speak 

a  word  of  English: 

a.  Why  was  a  cabinet  organized  to  help  Georgo  J  rule  Kngland? 

b.  What  line  of  kings  ascended  the  English  tin-one  with 
George  I  of  Hanover? 

3.  In  the  eighteenth  century,  the  government  of  Poland  was  tlu 
worst  imaginable.  The  Polish  long  could  not  declare  war.  make 
peace,  impose  taxes,  or  pass  any  law  withoul  the  eonsenl  of  the 
diet.  The  diel  wras  composed  of  nobles  and  any  one  of  the  nobles 
could  prevent,  any  measure  from  becoming  law  by  his  veto. 
Russia,  Prussia,  and  Austria  were  Poland's  neighbors  and  wanted 
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to  take  her  territory  from  her.  Whenever  the  Poles  attempted 
to  strengthen  their  government,  Russia,  Prussia,  and  Austria 
would  interfere  and  prevenl  them. 

a.  Why  did    Russia,   Prussia,  and  Austria   interfere  in    Polish 
affairs  and  help  keep  the  Polish  governmenl  weak? 

b.  What    do   you    think    Russia,    Prussia,  and    Austria    would 
eventually  do  with  the  Polish  territory? 

I.  England  is  aboul  the  size  of  the  state  of  Illinois.  The  population 
of  England  is  aboul  40,000,000.  On  account  of  its  small  area, 
England  is  unable  to  raise  enough  food  to  support  her  population. 
England's  chief  occupation  is  manufacturing.  England  is  unable 
to  use  all  the  goods  she  manufactures. 

(/.    How  do  you  account  for  England's  colonial  empin  '.' 
I>.    Why  docs  England  insist,  on  having  the  largesl  navy  in  the 
world? 

."».    Belgium  is  a   low,    level    plain.     To    the   south    of    Belgium    the 

country  is  hilly  and  mountainous.      In  this  region  the  Swiss  and 

French  nations  have  heavy  fortifications  along  their  boundaries. 

</.    Why  did  the  Germans  in  the  World  War  cross  Belgium  in 

t  heir  attempt  to  reach  France? 

6.  (a)  In  17('>7,  Hargreaves,  an  English  spinner,  invented  the  spin- 
ning jenny.  In  1768,  Arkwrighl  patented  a  device  for  drawing 
nut  threads  by  means  of  rollers.  In  177!),  Crompton  invented 
the  "mule",  a  combination  of  Eargreaves'  spinning  jenny  and 
Arkwright's  roller  machine.  These  spinning  and  weaving 
machines  made  possible  an  enormous  output  of  thread  and  yarn. 
I'])  to  this  time  there  was  no  way  to  separate  the  seeds  from  the 
cotton  except  by  hand  and  a,  worker  could  only  clean  about  five 
or  six  pounds  a  day  working  in  this  way. 

o.    Why  was  the  cotton-gin  invented? 

l>.    Why  was  the  cotton-gin  invented  in  the  United  States'.' 
(b)    By  the  use  of  the  cotton-gin,  a  slave  could  take  the  seeds  rut 
of  over  a  thousand  pounds  of  cotton  a.  day,  instead  of  five  or  six 
pounds  as  by  hand  method. 

'/.  What  effect  did  the  cotton-gin  have  upon  slavery  in  the 
United  States? 

7.  The  Austro-Hungarian  Empire  was  composed  of  an  extraordinary 
mixture  of  peoples.  In  Austria-Hungary  were  found  Germans, 
Czechs,  Poles,  Croatians,  Italians,  Slovenes,  Serbs,  Ruthenes, 
Slovaks,  and  Roumanians.  In  general  each  of  these  people  lived 
adjoining  their  fatherland,  i.e..  the  Italians  in  Austria-Hungary 
lived  in  territory  adjacent  to  Italy,  the  Roumanians  in  territory 
adjacenl  to  Roumania,  etc.  These  peoples  were  not  satisfied  at 
all  with  the  Austro-Hungarian  rule  and  were  anxious  to  be 
annexed  to  1  heir  nat  i\  e  count  ries. 

a.  Why  was  the  Austro-Hungarian  governmenl  deeply  con- 
cerned with  what,  went  oil  in  a  political  way  in  Germany, 
Italy,  Roumania,  Serbia,  and  in  all  the  countries  about  her? 

/'.  When  Austria-Hungary  was  defeated  in  the  World  War 
what  would  you  expect  would  happen  to  her  different 
territories? 

8.  Turkey  has  always  been  a,  relatn  ely  veak  nation.  ( lonstant  inople, 
the  capital  of  Turkev,  has  a  very  important  strategic  location. 
controlling  the  entrance  to  and  the  outlet  of  the  Black  Sea.  It 
also  controls  the  bridgehead,  Asia  Minor,  through  which  overland 
commerce  is  carried  from  Asia  to  Europe  and  vice  versa.     Eng- 
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land  is  much  interested  as  Asia  Minor  is  on  the  road  to  her 
possession,  India.  Germany  has  been  developing  her  commerce 
with  the  East,  especially  in  the  Tigris-Euphrates  region.  Russia, 
tlic  great  sia\  nation  and  "big  brother"  to  the  SlaA  states  of  the 
Balkan  peninsula,  has  been  a  strong  growing  nation,  hut  has  been 
handicapped  on  accounl  of  an  out  lot  to  the  sea,  having  never  had 
an  ice-free  port.  Knssia  lias  coveted  the  possession  of  Constan- 
tinople and  would  have  seized  it.  after  defeating  Turkey  in  war, 
had  not   England,  Austria,    and  Germany    prevented  her. 

a.    Why  did   England,  Austria,  and  Germany   pr6ven1    Russia 
from  taking  and  controlling  Constantinople? 

!).  Belgium  is  a  small  stair  just,  across  the  channel  easl  from  Eng- 
land. It  is,  in  fact,  a  buffer  state  between  England  and  any 
strong  power  thai  mighl  arise  on  the  continenl  of  Europe.  Eng- 
land has  always  insisted  thai  the  territorial  integrity  of  Belgium 
he  observed  by  the  European  nations.  As  long  as  this  is  done 
England  mayfeel  prettj  safe  from  attack  from  the  east.  Ireland 
lies  ahout  as  far  west  of  England  as  Belgium  lies  east,.  In  land  i- 
a  part  of  t ho  British  Isles  but  is  now  endeavoring  to  secure  it > 
independi  nee. 

a.    What,   perhaps,  is  one  reason  why   England  will  not  give 
Ireland  its  freedom? 

10.  The  i  as:  coast  of  Italy  is  very  regular  and  has  no  good  ports  or 
harbors.  Across  the  Adriatic  Sea  from  Italy,  the  Dalmatian 
coast  line  is  very  rough  and  irregular  and  affords  excellent  places 
for  harbors  and  fortifications.  The  Italians  have  frequently 
stated  that  on  account  of  the  smoothness  and  regularity  of  their 
east  coast  their  country  is  exposed  to  attack  from  that  quarter. 

a.    Why  did   the   Italian  government  demand  the  Dalmatian 
coasl  line  as  Italy's  reward  for  its  efforts  in  the  World  War'.' 


TEST  E  —  INFORMATIONAL 

I.         Below  you  will  find  six  questions.      Answer  each  question  in  the  blank 
space  Ik  low  or  following  it. 

1.    What  are  the  "natural"*  boundaries  of  Prance? 

-.    Mention  the  names  of  two  Spanish  explorers  in  North  America. 
Two  English  explorers. 
Two  French  explorers. 

:;.    Name  four  greal  benevolenl  despots  of  the  eighteenth  century. 

I.     Identify    I  he   following   personages.      In   each   case   use   hut   two 
words  in  your  answer,  giving  the  nationality  of  the  man  and  the 

t  hing  for  which  he  is  noted. 

'/.  Adam  Smil  h 

b.  Karl  Marx 

c.  Sir  Walter  Scot  l 
>l.  Rousseau 

e.  John  Weslej 

./'.  Gladstone 

g.  Darwin 

h.  Robespierre 

i.  I  >uke  of  Wellington 

j.  Koch 
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.").    Identify   the  following  dates  by   tolling  what  important   event. 
happened  on  each  of  them: 

a.  1S32 

b.  1815 

c.  15)14 

d.  1648 

e.  1878 

f.  170:; 

g.  1871 

'/;,  1789 

/.  1823 

j.  1848 

6.    What    European   nations    secured    possessions    in    Africa    in    the 
nineteenth  century? 


School  Boards  in  Indiana 


Willis  A.  1  Eolim  w 

This  study  was  begun  in  1U17.  It  was  hoped  thai  a  more  definite  know- 
Ledge  of  the  personnel  of  school  boards,  the  fitness  <»r  members  for  the  work, 
what  they  are  doing  as  board  members,  and  how  much  power  they  are  giving 
their  school  administrators  mighl  be  obtained.     This  has  been  accomplished. 

The  questionnaire  method  for  gathering  data  was  used.  The  question- 
naire was  approved  by  the  Dean  of  the  School  of  Education  of  Indiana  Uni- 
versity. These  interrogatories  were  senl  to  22s  superintendents  of  the  city, 
town,  and  joinl  schools  —  thai  being  the  number  listed  in  the  official  directors 
of  1010-17  where  commissioned  schools  were  maintained  78   cities,    L35 

towns,  15  joint  corporations. 

One  hundred  seventeen  systems  replied  in  such  a  manner  that  material 
could  be  used  as  a  whole  or  in  part.  Reports  were  received  from  70  per  cenl 
of  cities,  .">()  per  cent  of  towns,  and  100  per  cent  of  joint  corporations.  One 
wonders  just  why  the  smallest  per  cent  of  returns  was  received  from  the 
towns.  The  census  report  of  1910  was  used  in  tabulating  the  population  of 
towns  and  cities.  The  maximum  size  of  towns  entering  into  a  joint  corpora- 
tion was  3,500.  There  are  35  other  towns  and  10  cities  falling  below  this 
population.  If  consolidation  of  schools  makes  for  efficiency  in  school  matters, 
here  are  4f>  of  the  larger  centers  that  may  well  unite  with  the  rural  com- 
munities of  which  they  are  a  part  and  make  a  larger  school  unit. 

Sex 

Concerning  the  personnel  of  school  hoards  in  cities,  it  was  found  that  90.8 
per  cent  of  members  were  men  and  5  per  cent  were  women.  In  4.2  per  cent 
of  cases  sex  was  not  reported.  In  towns  100  per  cent  were  men.  In  joint 
corporations  00.0  per  cent  were  men  and  3.4  per  cent  were  women. 

Age 

The  investigation  concerning  the  age  of  board   members  revealed  the 

following  facts:  The  minimum  age  for  members  in  cities  was  27,  in  towns 
2N,  and  joint  schools  25;  there  was  only  1  age  al  2.">.  and  there  wen-  only  8 
in  the  3  groups  under  30  years.  The  recent  session  of  the  General  Assembly 
tixed  the  minimum  age  limit  for  certain  city  school  corporations  at  25. 
The  minimum  age  for  these  cities  is  already  27.  The  maximum  age  given 
in  same  order  was  70,  70.  and  65.  The  median  ages  were  15. oX,  l.>.  and  44. .S 
respectively.     This  makes  an  average  median  age  of  15  years.     Certainly  no 

one  can  complain  thai  mem  hers  of  sol 1  hoards  of  Indiana  are  unfit  because 

of  t  heir  youl  h, 

Residence 

The  ne\i  question  with  which  we  dealt  was  that  of  residence  in  the 
community.  There  was  an  83  per  cenl  report  on  1  h is  item  for  the  cities 
reporting,  90  per  cenl  for  towns,  78  per  cenl  for  the  jcinl  corporations.     The 

(69) 
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minimum  years  for  the  3  types  of  boards  mentioned  were  5,  2,  2  respecth  ely. 
The  last  session  of  the  General  Assembly  passed  a  law  establishing  a  residence 
qualification  for  school  board  members  of  cities  of  a  certain  size,  fixing  the 
minimum  a1  3  years.  This  report  shows  that  the  minimum  residence  for 
those  cities  was  5  years.  The  maximum  years  of  residence  was  found  to 
be  79,  70,  and  60;  the  median  years  of  residence,  40.04,  30,  and  40  years 
respectively,  and  the  average  median  number  of  years  was  found  to  be  36.68. 
In  ">  joint  and  town  corporations  appointments  were  made  of  persons  who 
had  lived  in  the  community  under  5  years.  This  qualification  also  seems 
to  be  taking  care  of  itself  very  well. 

Occupation 

"What  occupations  do  the  members  of  school  boards  follow'.'"  was 
another  inquiry.  The  occupations  were  classified  according  to  the  system 
used  by  the  U.S.  Census  Bureau.  Tn  the  cities  33  occupations  distributed 
among  8  of  the  9  main  groups  were  found.  One  hundred  fifty-seven  reports 
were  received  concerning  162  board  members.  Sixty-five  of  these  were 
following  trade  pursuits,  43  professional.  27  manufacturing,  domestic  and 
personal  service  8,  transportation  6,  clerical  pursuits  4,  farming  and  public 
service  2  each.  In  the  towns  we  found  7  of  the  8  mam  groups  -  domestic 
and  personal  service  group  dropping  out--  with  trade,  professional  pursuits, 
and  manufacturing  and  mechanical  leading  as  in  the  cities  and  the  farmer 
advancing  from  eighth  place  to  fourth.  In  the  joint  corporations  we  found 
clerical  pursuits  eliminated  with  only  6  groups  remaining.  Trades  and 
professional  pursuits  occupied  first  and  second  place,  but  the  farmer  occupied 
third  place  and  manufacturing  fourth.  I  think  the  reasons  for  these  changes 
are  obvious,  and  no  comments  need  be  made  here. 

Length  in  Occupation 

The  time  various  members  have  followed  present  occupations  varied 
from  1  to  <)•">  years,  with  an  average  median  of  lb. 73  years.  Less  than  8 
per  cent  had  followed  their  present  occupations  fcr  less  than  5  years.  I 
think  this  part  of  the  report  shows  that  m  the  mam  school  board  members 
have  been  actively  identified  with  the  industrial  and  professional  life  of  the 
community. 

Education 

From  the  city  reports  we  have  the  educational  records  of  146  of  the  162 
board  members.  One  went  no  farther  than  fourth  grade;  139  or  84.79  per 
cent  finished  the  eighth  grade;  7S  finished  high  school;  24  finished  college; 
and  3  did  1  year  cf  postgraduate  work.  One  finished  a  3-year  normal 
course  and  11  took  a  business  course.  We  have  the  record  of  112  of  the  120 
members  of  town  school  boards.  Ninety-nine  finished  the  elementarj 
schools;  44  the  high  schools;  12  finished  the  college  course;  and  4  did  post- 
graduate work  of  1  year  or  more.  Four  had  a  3-year  normal  course  and 
(I  had  a  business  course.  The  educational  data  concerning  the  members  of 
joint  boards  revealed  the  following:  The  record  of  48  of  the  60  reported 
shows  that  48  finished  the  elementary  school  work;  24  finished  4  years  of 
high  school;  4  remained  in  college  4  years;  2  attended  normal  school  3  years; 
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and  .'!  took  business  courses.     To  summarize,  the  educational  qualifications 

of  board  members  I'm-  the  '■>  types  of  schools  were  ah  Follows: 

92.  I  percent  finished  elementary  schools. 

17.7  per  cenl  remained  in  high  school  4  year-. 

13  per  cent  unit  to  collide  4  years  or  longer. 

6.5  per  cenl  had  a  business  course. 

Tin1  Indiana  law  gives  board  members  almost  unlimited  power.  Persons 
arc  not  usually  given  this  power  because  of  their  profound  wisdom  con- 
cerning school  matters.  1  leave  it  to  those  who  pay  the  bills  to  decide 
whether  hoard  members  should  not  be  pruned  of  some  of  their  power  or 
their  qualifications  raised.  It'  horse  sense  is  all  that  is  necessary  we  per- 
haps have  enough  of  that. 

Salaries 

Of  course  the  financial  remuneration  is  not  sufficient  to  justify  any  board 
member  in  devoting  much  time  and  attention  to  school  matters,  the  rang< 
of  salaries  being  from  $25  to  $800  in  cities,  nothing  to  $100  in  towns  and 
joint  corporations.  The  median  salary  in  cities  is  $89.30,  town-  $45,  joint 
boards  $25,  and  trustees  $000  to  $800.  About  20  per  cenl  of  these  board 
members  have  served  in  former  years  either  as  teacher,  principal,  or  town- 
ship trustee. 

Term 

The  range  in  years  of  service  on  school  boards  runs  from  1  to  21  years. 
The  average  median  is  3.58  years.  This  is  doubtless  long  enough  for  a  poor 
member  to  serve,  but  it  is  far  too  short  for  a  good  member.  Only  a  very 
small  per  cent  of  board  members  are  unmarried.  All  women  are'  either 
married  or  are  widows.  Only  12.8  per  cent  were  reported  as  having  no 
children. 

Church 

In  cities,  10  per  cent  were  reported  as  members  cf  no  church;  L5  per 
cent  were  Catholics,  leaving  about  80  per  cent  as  members  <>f  Protestanl 
churches.  In  the  towns,  20  per  cent  are  members  of  no  church,  while  in  the 
joint  systems  21.4  percent  belong  to  no  church  either  Catholic  of  Protestant. 

Politics 

In  discussing  politics  it  is  difficult  to  draw  conclusions.  The  returns 
shewed  that  in  the  3  types  of  schools  where  the  city  councils  were  LOO  per 
cent  of  one  party,  the  school  board  was  either  100  per  cent  of  the  same 
party  or  were  becoming  so  as  rapidly  as  appointments  could  be  made.  This 
leads  one  to  believe  that  party  lines  have  been  adhered  1o  very  closely  in 
school  board  matters.  Even  the  legislature  two  years  ago  recognized  thai 
such  a  condition  existed,  because  a  bill  was  passed  and  is  new  law  stating 
that  no  more  than  2  of  3  board  members  shall  belong  to  the  party  in  power. 
Like  a  great  many  other  good  intentions  of  the  state  legislature,  it  remains 
to  be  seen  whether  the  situation  will  be  helped  or  whether  the  party  in  power 
will  appoint  a  member  of  the  opposite  part\  who  will  submit  to  everything 
the  majority  wishes.  I  predict  thai  this  law  will  help  the  schools  none. 
But  every  school  man  knows  after  a  little  experience  in  the  field  that  partisan 
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politics  is  not  the  only  kind  that  is  damning  the  schools  of  Indiana.  It  may 
not  even  be  the  worst  kind.  Bui  I  need  no1  go  farther  in  this  paper  with 
that. 

Work 

Wo  shall  now  turn  to  the  work  which  the  school  hoards  arc  doing.  We 
shall   mention  a  number  of  things  but  cannot  enumerate  all  in  this  report. 

a.  Superintendent.  The  boards  select  the  superintendent,  but  they  have 
not  as  yet  in  many  places  come  to  realize  his  importance  in  1  lie  school  system. 

b.  Teachers.  Aboul  tit)  per  cent  of  the  teachers  and  principals  ap- 
pointed in  the  '■'>  types  of  schools  are  appointed  upon  recommendations  of 
the  superintendents.  Jn  a  number  of  cases  the  superintendent  seems  to  be 
ignored  by  the  board,  and  it  is  very  noticeable  that  his  opinion  counts  for 
more  in  the  larger  units.  There  are  some  places  where  the  superintendent 
seems  to  be  all-powerful,  but  in  mosl  of  the  other  10  per  cent,  the  boards 
make  their  own  selection.  This  is  especially  true  in  the  smaller  types  cf 
schools.  It  can  partly  be  accounted  for  by  virtue  of  the  fact  thai  the 
superintendent  may  not,  have  been  giving  his  attention  to  this  work  during 
the  sunimer.  Promotion  and  assignment  of  teachers  are  left  to  superinten- 
dents in  at  least  7.~>  per  cent  of  cases. 

c.  Janitors.  The  same  may  be  said  concerning  the  employment  of 
janitors,  except  that  a  much  larger  percentage  are  employed  without  the 
superintendent's  knowing  who  is  employed,  or  when. 

(I.  Boards  Visit  Schools.  !n  a  few  localities  school  board  members 
are  frequent  visitors  at  the  schools.  Of  the  00  boards  reported,  about  40 
per  cent  did  visit  schools  either  singly  or  as  a  body  during  the  year.  Of  all 
board  visits  made.  51.3  per  cent  were  in  towns  and  cities  ranging  from 800 
lo  5,000.  Matters  of  discipline  and  social  affairs  are  left  almost  exclusively 
to  the  superintendent,  principals,  and  teachers.  Less  than  3  per  cent  of 
boards  mix  in  1  hese  affair-. 

c  Curriculum.  Making  of  curricula,  is  left  almost,  entirely  to  the 
su  perintendenl . 

/'.  Meetings.  About  72  per  cent  of  school  boards  meet  regularly.  They 
usually  meet  in  the  office  of  some  member  of  the  board.  About  50  per  cent 
of  city  boards  meet  in  the  office  of  superintendent;  26  per  cenl  of  town  and 
perhaps  12  per  cent  of  joint  boards  meet  in  the  superintendent's  office. 
Curbstone  meetings  are  not  unknown.  Ninety  per  cenl  of  the  superin- 
tendents attend  the  board  meetings  regularly,  but  a  few  stated  thai  they  do 
not  attend  unless  they  are  called  in  by  the  board.  This  is  found  to  be  true 
even  in  city  systems. 

g.  Committees.  The  reports  show  that  about  5  per  cent  of  boards  keep 
standing  committees;  that  -  per  cenl  of  these  are  found  in  cities  of  10,000 
or  less.  Business  matters  are  usually  handled  by  the  board  as  a  whole  or 
certain  members  of  beard:  the  superintendent,  or  both,  are  appointed 
temporarily. 

h.  Minutes.  Four  per  cent  of  cities  reporl  thai  the  minutes  are  inac- 
curately written  and  poorly  kepi.  The  same  is  reported  concerning  12.5 
per  cent  of  towns  and  20  per  cenl  of  joint  corporations.  Of  all  minutes  in 
cities.  17  per  cent  are  written  by  the  superintendent  or  under  his  super- 
vision and  kept    in  his  office.      The  same  may  be  said  of  the  towns,  but  the 
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superintended  has  nothing  to  do  with  the  records  in  the  joinl  corporations 
reported. 

i.  Clerks.  Forty-three  i >« ■  i-  cenl  of  boards  in  the  •!  types  of  schools 
employ  no  clerk.  Seventy-one  per  cenl  of  cities,  reporting  on  this  item, 
furnish  clerks  from  :'>  to  12  months  each  year.  Cities  nol  furnishing  any 
clerk  range  from  2,500  population  to  8,000.  Thirty-eighl  of  l<>  towns  re- 
ported this  item.  Pour  <»!'  this  number  furnish  dirks  only  when  needed. 
One  hires  office  help  full  time.     Size  of  towns,  2,000  to  6,000. 

j.  Programs.  Hoard  meetings  occur  in  cities  at  stated  times.  They 
meet  weekly  in  8  per  cenl  nt'  cities  reporting;  t\\  ice  per  month  in  26  per  cent; 
monthly  in  66  per  cent.  In  towns  7.">  per  cenl  meet  monthly;  5  per  cent 
twice  per  month;  and  20  per  cent  meet  irregularly.  Joinl  corporations 
usually  meet  monl  lily. 

In  cities  members  are  usually  punctual.  In  towns  and  joinl  corporations 
20  per  cent  are  not.  Fifty-five  per  cent  of  cities.  20  per  cent  of  towns,  and 
35  per  cent  of  joint  schools  have  a  regular  order  of  procedure.     The  regular 

order  of  business  is  somewhat  as  follows: 

1.  Meeting  called  to  order. 

2.  Reading  of  minutes  of  last  meeting. 

3.  Allowance  of  bills. 

4.  Unfinished  business. 

5.  New  business. 

6.  When  time  permits  superintendent  may  make  reports  and  sugges- 
tions. 

7.  Adjournment  —  more  or  Less   irregularly. 

Four  per  cent  of  cities  reported  thai  the  superintendent's  advice  con- 
cerning financial  and  general  policies  of  school  is  never  sought.  Eight  per 
cent  of  towns  and  25  per  cent  of  joint  corporations  report  same. 

/:.  Reports.  The  matter  of  making:  reports  to  school  hoard-  concerning 
the  school  work  and  conditions  is  very  generally  Left  to  the  superintendent, 
altho  in  a  few  cases  teachers  and  principals  make  such  reports  directly  to 
board.  Frequency  of  reports  varies,  li  usually  depends  upon  the  wish  of 
the  superintendent.  Items  included  also  vary  with  conditions.  I  think 
types  of  reports  mighl  be  improved  upon.  Too  much  attention  is  given  to 
detail.  Statistical  reports  to  county  and  slate  superintendents  are  made  by 
the  local  superintendent  in  <s<>  percent  of  cities;  67.5  percent  in  towns  (26.5 
per  cent  with  his  help;  40  per  cent  in  joint  schools  In  per  cent  with  bis 
help). 

The  third  topic  with  which  the  thesis  deal-  is  the  matter  of  purchasing 
supplies.  Cn  the  cities,  84  per  cent  of  supplies  for  instruction.  7s  per  cut  of 
janitor's  supplies.  86  per  cent  of  Library  and  Laboratory  supplies,  and  L6  per 
cent  of  fuel  were  purchased  by  superintendent.  Sixty-two  percent  of  fuel 
was  purchased  by  hoard  and  12  percent  by  both  board  and  superintendent. 
Exclusive  of  the  fuel  item.  82.5  p<  r  cenl  of  all  purchases  made,  outside  of  a 
very  few  cities  that  employ  a  regular  purchasing  agent,  were  purchased  thru 
the  superintendent's  office.  We  are  safe  in  saying  thai  at  Leasl  75  per  cenl 
of  all  school  luisiness  is  done  thru  the  superintendent's  office.  All  other 
purchases  are  made  by  janitor-,  teachers,  supervisors,  principal-,  and  board 
members.     In  town-  the  amounl  purchased  i>.\  tin   superintendent  was  L< 
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lie  purchased  about  75  per  cent  of  supplies  for  instruction,  50  per  cent  of 
janitor's  supplies,  and  70  per  cent  of  library  and  laboratory  supplies.  Ninety- 
five  per  cenl  of  fuel  was  purchased  by  board.  Exclusive  of  fuel,  about  65 
per  cenl  of  all  purchases  made  were  by  the  superintendent.  In  the  joint 
schools,  about  73  per  cent  of  supplies  for  instruction  were  purchased  by  the 
superintendent.  Twenty-seven  per  cent  of  janitor's  supplies,  93  per  cent  of 
library  and  laboratory  supplies,  and  6.6  per  cent  of  fuel  were  purchased  by 
him.  The  board  purchased  about  04  per  cent  of  fuel,  47  per  cent  of  janitor's 
supplies,  and  20  per  cent  of  supplies  for  instruction. 

And  thus  we  might  continue  at  greater  length,  but  enough  has  already 
been  given  to  show  that  a  school  superintendent  in  Indiana  is  largely  becom- 
ing a  school  manager.  The  matter  of  classroom  supervision  is  being  more 
and  more  left  to  supervisors  and  principals,  whether  for  better  or  for  worse. 
The  natural  growth  of  the  school  system  makes  it  imperative  that  the  super- 
intendent devote  more  and  more  of  his  time  to  the  business  side  of  school 
affairs.  School  boards  are  by  law  recognized  as  doing  this  work,  but  the 
facts  show  they  are  not.  Most  of  them  cannot  take  the  time  to  do  it  if  they 
wished.  Besides,  there  is  not  enough  remuneration  to  justify  their  spending 
their  time  with  such  work.      I   may  summarize  somewhat  as  follows: 

1.  The  personnel  of  school  boards  consists  mainly  of  men  who  meet 
higher  qualifications  than  any  Indiana  law  fixes.  They  are  men  of  ordinary 
intelligence.  They  are  connected  with  the  business  and  professional  interests 
of  the  community.  They  have  lived  long  enough  in  the  community  in  most 
cases  to  know  something  of  the  educational  needs.  The  ;i»v  of  board  members 
shows  them  to  be  men  of  maturity.     The  term  for  a  good  member  is  too  short 

three  years  and  six  months.  They  are  evidently  not  free  from  political 
influence. 

2.  The  board's  duties  and  those  of  the  superintendent  are  not  clearly 
marked.  Until  the  special  field  which  each  is  to  occupy  is  defined  there  is 
always  a  chance  that  one  will  interfere  with  the  other. 

3.  In  making  of  curricula  the  superintendent  has  a  clear  field. 

4.  The  matter  of  what  to  report  in  board  meetings  and  when  is  de- 
serving of  some  careful  thought  and  attention. 

5.  There  is  need  for  regular  meeting-places  and  punctuality  in  atten- 
dance. 

6.  A  very  large  per  cent  of  the  business  of  the  schools  is  being  transacted 
thru  tlie  superintendent's  office. 


